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EXECUTIVE  SUMMARY 


The  SAT  Approach 

Instructional  System  Development  (ISD)  is  a structured  process  for 

fr°r  r iraini"8  (sat) 

25  sir 

syllabi  for  le  a""™  of  tZ  5 f T 1"  applled  t0  the  development  of  the 


rather  tha^  r^  SS  slops  ^Before^mb'  j-  “ C°nCfptUal  fra”ework 
program  an  information  flow,  luimarized  i^Se 

tualized  to  define  the  seope  of  the  training  system  and  io  enter  the  ann™ 
the  devoloplent  JfCi"st™c?ion  Pltty  " SUCh  inf0r"ati°"  ‘"P“«s  on 


delineate  ^ "whlVT'  Behavioral  Objectives  were  developed  which 

Cr  . „ ; Sf i “•  Uhe"  atnd  h°“  **”"  ? «ch  definable  behavior 

- p.rrorm  tne  mission.  In  the  process  of  writing  these  objectives 

I A/'+t  A. • • . * 


'first  cut 


_bumea  to  be  m the  entering  repertoire  of  all  trainees  or 


The  data  reported  in  this  document  reflect  the  latest  calculations  and  may, 
t cretore  deviate  somewhat  from  data  released  prior  to  10  October  1975. 
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cludLCin  the^obj ectives°are"such^thitrainin^  or. ^'.Performance  aids).  I„. 
information,  specific  crew  mn-rdi  t-n®S  aS  <i:ritlcal;ity/difficulty/frequenc> 

of  the  supporting  behaviors ^ j i^"rLS ^Mch"  “V'**  liStin* 
prerequisite  to  training  of  the  behaxior^  proficiency  is  a 


The  process  of  selecting  tasks  for  training  is  continued  in  the  con- 
sideration . of  the  Personnel  Qualifications,  where  the  trainees  may  have  a wide 
variation  m their  available  incoming  skills  and  knowledges.  The  Behavioral 
Objectives  that  are  not  in  the  incoming  trainee's  repertoire  (arranged  in  a 
hierarchy  of  learning  sequence)  and  the  performance  standards  which  the  train- 
ee is  to  demonstrate  comprise  the  Training  Requirements. 


. . . ':XiStin®  knowledge  of  psychological  learning  principles  and  educa- 

tionai  methods  and  media  are  combined  in  the  Methods/Media  Selection  process 

ieJtiv^rVi5  api?lled  t0  l°8ical  groupings  of  enabling  and  behavioral  ob- 
je  tives  to  determine  the  educational  strategies  and  media  which  will  provide 
the  optimum  training  environments  for  these  groupings.  The  resulting  Ustine 

Uonaf  6 educational  strategies  are  used  as  inputs  to^nst^c? 

tional  Blocks  and  Courses,  and  as  alternatives  to  be  optimized  in  the~raininp 

R^ource^^  (TRAM)  under  the  many  constrafnts  cf  Ext^ff^ 

SSlSrl;  Zll  aS  COSv’  training  equipment  a-ilable,  number  'of  personnel 
required  m each  speciality  to  support  the  system,  and  so  forth. 


all  a application  of  ^e  TRAM  to  the  hypothesized  course  design 

allowed  the  preferred  Instructional  System  Desi™  to  h*  ™ 

of  documentable  criterlTTnotably  time  and  exactors.  ThfmocLs  of 
^valuation,  while  indicated  by  only  a small  block  in  the  Figure,  is  actually 
iarge  effort  consisting  of  courseware  development,  validation  of  the  course 
ware,  feedback  of  the  findings  to  all  relevant  points  in  the  design  deve^oL 
ment  process,  and  successive  "fine  tuning"  until  the  trainees  are^eing  taught 
the  behaviors  required  to  carry  out  their  mission,  and  onlv  those  behaviors8 
with  the  minimum  usage  of  training  resources.  ' oenaviors, 


This  SAT  process,  if  applied  by  a 
provide  a number  of  benefits: 


suitable  team  of  analysts. 


can 


orderliness  --  Each  set  of  data  required  by  the  analysis  is 

called  out  in  the  schema  of  the  Figure  (more  precisely 
s su  sets  of  those  blocks  in  an  elaborated  version) . a 
Specialist  can  then  be  assigned  to  carry  out  the 
information  gathering  and/or  decision  making  as  indicated. 

completeness  --Each  element  of  the  system  that  impacts  on  the 
decision  process  is  delineated. 


relevance 


— The  SAT  process  starts  with  job  performance 
requirements  in  the  form  of  a task  analysis: 
succeeding  decision  is  traceable  back  to  those 
requirements. 


each 


IV 


economy  --  Systems  analytic  techniques  make  possible  the 
optimization  of  alternatives  with  respect  to 
cost  and  time,  aided  by  sensitivity  analyses 
of  critical  variables. 

documentation  --  The  sets  of  data  (blocks  in  the  Figure) 
provide  the  rationale  for  each  necessary 
decision;  each  decision  becomes  a data  point 
in  its  own  right  to  support  subsequent  blocks. 
Documentable  data,  therefore,  include  descrip- 
tive facts,  research  results,  assumptions, 
decisions  and  constraints. 

evaluation  --  Invalid  data  (facts,  decisions,  etc.)  are 
brought  to  light  through  feedback  from  train- 
ing system  outputs. 


Program  Objectives 

. This  study  has  defined  the  training  system  for  B-l  aircrew  members 

including: 


1.  Transition  --  personnel  from  a variety  of  sources, 
differing  in  relevant  training  and  experience,  are 
trained  for  an  assignment  to  a B-l  crew  position; 

2.  Upgrade  --  A B-l  crew  member  is  trained  for  a more 
demanding  B-l  assignment;  specifically  copilot  to  pilot;  and, 

3.  P.ecurring  --  periodic  proficiency  training  to  maintain 
combat  readiness. 

The  study  also  formulated  the  basic  course  structure  for  such  train- 
ing. Developed  were: 

1.  Behavioral  (enabling  and  criterion)  objectives; 

2.  A syllabus  for  each  course; 

3.  A review  of  the  state-of-the-art  in  the  engineering  and 
behavioral  aspects  of  training  devices; 

4.  The  total  mix  of  instructional  equipment  required  to 
support  aircrew  training  courses; 

5.  Functional  descriptions  of  recommended  training  devices; 


6.  Time-phased  trainee  flow  requirements; 

7.  Facilities  required; 

8.  Instructors  and  support  personnel  required; 

9.  Time-phased  costs  and  utilization  of  training  resources; 

10.  A Sorting  Program  to  employ  computer  capability  in  the 
storage,  collating,  and  updating  of  the  task  analysis  data 
base;  and. 


11.  A Training  Resources  Analytic  Model  (TRAM)  to  carry  out 
computer  simulations  and  evaluations  of  the  proposed  training 
systems  and  alternatives  based  on  B-l  deployment  factors,  re- 
source availability,  costs,  trainee  sources,  attrition  rates, 
and  a variety  of  other  variables.  This  model  is  used  to  gen- 
erate many  of  the  other  outputs  listed. 


Included  in  this  analysis  are  the  crew  positions  of  Pil gft,  Copilot, 
and  Offensive  Systems  Operator.  The  task  analysis  for  the  De£efisive  Systems 
Operator  (DSO)  was  not  ready  for  delivery  to  Calspan  to  be^ficorporated  into 
this  SAT  analysis.  Some  rudimentary  assumptions  were  imyle regarding  the  DSO 
training  requirements  so  that  a preliminary  estimate the  impact  of  the  DSO 
syllabus  could  be  calculated. 

Program  Guidelines 

Every  attempt  was  made  to  er^dre  that  this  analysis  was  respon- 
sive to  the  needs  of  the  B-l  SPO  ami' the  Strategic  Air  Command.  To  that  end 
many  of  the  parameter  values  wer/a'haken  from  the  latest  B-l  Concept  of  Employ- 
ment, the  latest  maintenance ^dncept  (centralized  facilities),  and  specific 
direction  from  the  proj  ect/technical  officer  and  his  SAC  consultants  (from 
the  509th  Bomb  Wing,  Pep^e  AFB,  and  the  4200th  Test  and  Evaluation  Squadron, 
Edwards  AFB).  Much  w^Lght  was  given  to  the  FB-111  CCTS  (Combat  £rew  Training 
School)  experience^as  related  by  their  personnel  to  Calspan 's  analysts.  It 
was  assumed  tha^the  total  number  of  operational  B-l  air  vehicles  will  be  210; 
the  CCTS  wiy/be  centralized;  and  trainee  sources  ave  expected  to  be  as  follows; 
follows; 


B-l  Pilots  from  B-l  Copilot  upgrades,  FB-111  Pilots,  B-52  Pilots 
KC-135  Pilots 

B-l  Copilots  from  B-52  Copilots,  KC-135  Copilots,  UPT  (Undergraduate 
Pilot  Training) 

B-l  0S0  from  FB-111  R/N,  B-52  R/N,  UNT  (Undergraduate  Navigator 
Training) 

B-l  DSO  from  B-52  EWO,  EWOT  (Electronic  Warfare  Officer  Training) 

In  general,  attrition  is  assumed  to  be  0.3  per  year  with  an  additional  0 2 due 
to  copilots  upgrading  to  pilots.  The  latest  air  vehicle  delivery  schedule  was 


K 


used  to  generate  the  time-phased  requirements  for  the  graduation  of  qualified 


crews . 

In  addition  to  the  assumptions  regarding  the  values  of  the  above  para- 
meters, the  SAT  analysts  selected  a number  of  instructional  strategies  as 
appropriate  for  the  B-l  aircrew  training  system.  Significant  among  them  are: 

1.  Base  new  skill/knowledge  on  earlier  training. 

2.  Early  start  on  training  needing  the  most  practice. 

3.  Organize  by  "systems  integrated  with  phase  of  flight." 

4.  Active  trainee  participation  preferred. 

5.  Early  "hands-on". 

6.  Self-paced  instruction  preferred. 

7.  Use  simplest  (least  costly)  applicable  device. 

The  use  of  these  strategies  in  combination  with  the  other  assump- 
tions and  the  general  methodology  of  the  systems  approach,  allowed  the  ana- 
lysts to  specify  the  most  economical  training  system  that  will  achieve  all  of 
the  training  objectives.  The  expenditure  of  more  funds  would  not  achieve 
significantly  greater  effectiveness  with  respect  to  satisfying  those  objec- 
tives and  the  expenditure  of  less  would  result  in  the  compromising  of 
obj  ectives. 

Instructional  Devices 

through  an  iterative  process  involving  the  interplay  of  the  training 
objectives,  the  instructional  strategies,  the  state-of-the-art  in  simulation, 
and  subject -matter-expert  opinion,  a set  of  training  media  were  defined  and 
refined  for  the  B-l  instructional  system.  A significant  difference  exists 
in  both  cost  and  capability  between  any  two  devices  of  the  set.  Because  of 
ambiguities  in  names,  the  devices  are  referred  to  by  designated  number.  How- 
ever in  the  summary  to  follow,  descriptive  names  are  offered  for  ease  of 
assimilation  of  the  information. 

Device  0;  General  Purpose  Carrel  (All  Crew  Members)  The  simplest, 
and  least  costly  device  is  what  is  generally  referred  to  as  a general  purpose 
carrel.  This  device  includes  an  audio-visual  presentation,  workspace  for 
writing,  and  a photographic  representation  of  the  cockpit  layout.  The  purpose 
of  this  device  is  for  individualized  instruction  of  material  that  does  not  in- 
volve active  manipulation  or  monitoring  of  controls  and  displays  by  the  train- 


vn 


Device  1;  Familiarization  Trainer  (Pilot/Copilot)  The  next  level 
of  complexity  that  is  required  on  the  basis  of  training  objectives  is  used 
to  familiarize  the  pilot  and  copilot  trainees  with  the  location  and  operation 
of  cockpit  controls  and  displays.  Device  1 incorporates  an  audio-visual  pres- 
entation. In  addition,  the  controls  and  displays  are  replicas  of  the  opera- 
tional equipment,  with  exact  location  and  approximate  control  "feel,"  but  with 
low  dynamic  fidelity. 

Device  2/P/CP,  2/0S0,  and  2/DSO:  Procedures  Trainers  Device  2 is 
used  to  practice  procedures  that  require  complex  interactions  between  the 
trainee  and  the  equipment  and  among  the  various  components  of  the  equipment. 
There  are  three  devices  that  are  used  for  this  purpose,  one  for  the  front 
station  (pilot  and  copilot),  one  for  the  0S0  and  one  for  the  DSO.  These 
devices  provide  total  interactiveness  between  controls  and  displays  in  terms 
of  normal  and  emergency  procedure  operations.  Because  maneuvers  are  not 
practiced  in  these  devices , flight  equation  calculations  are  not  incorporated 
in  these  trainers.  A mini-computer  controls  both  the  trainer  instrumentation 
and  the  sequencing  of  an  audio-visual  presentation  that  involves  branched  in- 
struction logic  on  the  basis  of  automatic  performance  measurement.  These 
devices  include  pre-programmed  malfunctions  during  procedures  as  well  as  on- 
line malfunction  inputs  by  instructor  personnel. 

Device  3/P/CP;  Part -Mission  Trainer  (Pilot/Copilot)  The  phases  of 
flight  that  require  an  extensive  amount  of  pilot  and  copilot  practice  in 
perceptual-motor  tasks  are  take-off,  refueling,  manual  terrain  following,  and 
landing.  Device  Number  3/P/CP  is  configured  for  the  training  of  the  objectives 
relating  to  these  flight  phases.  This  device  has  air  vehicle  replica  controls 
and  displays  that  respond  with  high  fidelity.  The  training  objectives  instruc- 
ted within  this  device  involve  precise  motor  control  that  requires  cueing 
from  both  bodily  motion  and  an  external  scene  representation.  For  these 
purposes,  a three  degree-of-freedom  motion  base  (roll,  pitch,  heave)  and  a 
night/'dusk  visual  scene  simulation  (point-lights)  are  recommended  for  this 
device.  Non-interactive  FLIR  tasks  are  practiced  using  a "canned  " but 
dynamic  FLIR  presentation.  Interactive  FLIR  is  practiced  during  airborne 
training  at  no  significant  increase  in  flying  time.  A dynamic,  interactive 
TFR  is  included  for  practice  using  this  primary  system. 

Device  3/0S0;  Part-Mission  Trainer  (0S0)  The  primary  phases-of- 
flight  in  which  high-fidelity,  real  time,  interactive  training  device  capa- 
bility is  required  for  0S0  training  objectives  are  high-level  navigation,  low- 
level  navigation,  aerial  refueling,  high  and  low  level  weapons  delivery,  bomb 
damage  assessment,  terrain  following,  and  instrument  landing  approaches.  The 
training  objectives  concerned  with  these  flight  phases  require  high  fidelity 
landmass,  navigation  systems,  and  weapons  delivery  simulation.  Digital  Radar 
l_andmass  (DRLM)  is  the  technique  required  to  meet  the  landmass  requirements. 

As  with  Device  3P/CP,  a "carrel"  FLIR  presentation  is  included.  The  calibra- 
tion capabilities  of  Device  3/0S0  are  sufficient  to  do  evaluative  scoring  of 
0S0  trainees  for  the  above-listed  activities.  A term  that  is  often  applied  to 
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devices  with  similar  capabilities  is  "avionics  trainer." 
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Device  3/DSO;  Part-Mission  Trainer  (DSO)  This  device  is  an  elec- 
tronic warfare  simulation  used  for  training  the  Defensive  Systems  Operator 
(DSO)  on  real-time  ECM  tasks.  The  primary  components  of  this  device  are 
various  data  input  (and  acquisition)  keyboards,  frequency  spectrum  display, 
threat  situation  display,  alphanumeric  display,  and  a cursor  control.  As 
with  Device  2/DSO,  a detailed  description  of  this  device  is  dependent  upon  the 
conduction  of  an  analysis  of  the  DSO  tasks,  but  it  is  expected  that  realistic 
programmed  scenarios  with  responsive  countermeasures  would  be  included. 

Device  4;  Full-Mission  Trainer  This  device  is  a total-crew  trainer 
that  provides  crew  coordinated  practice  of  the  EWO  mission.  The  0S0  and  DSO 
stations  of  this  device  are  the  same  as  Devices  3/0S0  and  3/DSO,  with  the 
addition  of  an  electronic/software  interface  between  the  trainers  to  provide 
crew  interaction  capabilities.  The  front  station  (pilot  and  copilot)  of  this 
device  is  similar  to  the  Device  3/P/CP,  with  the  addition  of  the  systems  not 
included  in  the  previously  described  device  (e.g.,  weapons  systems)  that  re- 
quire the  interface  with  the  0S0  and  DSO  stations.  This  device  an  be  utilized 
both  in  an  integrated-crew  mode  or  a crewmember-independent  mode  (e.g.,  0S0 
and  DSO,  practicing  interactively  with  the  front  station  being  totally  inde- 
pendent). As  with  the  component  devices,  this  trainer  incorporates  automatic 
performance  measurement,  performance  record  and  playback,  and  pre-programmed 
mission  capabilities.  The  instructor  can  be  at  a console  inside  the  cockpit 
during  early  training  or  outside  during  later,  when  he  may  be  able  to  monitor 
more  than  one  device. 

Preferred  Instructional  System 

All  devices  incorporate  automated  performance  measurement  as  an 
instructional  aid  to  the  trainee  and  instructor.  Computer  Managed  Instruction 
(CM I ) is  recommended  for  evaluation  and  planning  at  both  the  trainee  and  cur- 
riculum levels. 

Combat  Crew  Training  School  (CCTS)  uses  the  following  concepts. 
Students  enter  CCIS  on  an  individual  basis  (i.e.  not  in  classes)  with  starting 
dates  selected  to  provide  the  necessary  qualified  crews  to  man  a particular 
B--1  becoming  available.  Each  student  will  follow  a track  which  best  matches 
his  pi ior  training  and  experience.  Each  track  is  a series  of  instructional 
blocks  which  are  described  by  their  nominal  duration,  instructional  objective, 
and  the  medium  by  which  they  are  presented.  Typically,  an  instructional  block 
is  one  to  four  hours  long  and  uses  only  one  training  medium.  The  next  chart 
summarizes  for  each  track  the  hours  spent  in  each  medium  including  Devices  0, 
1,2,3,  and  4,  briefings,  and  B-l  utilization. 
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CCTS  SUMMARY  TABLE  OF  COURSE  DURATIONS  (HOURS) 
BY  TRAINING  DEVICE 


COURSE 

PILOT 

COPILOT 

OSO 

DSO2 

TRACK1 

■■ 

B 

C 

D 

E 

F 

G 

H 

J 

DEVICE 

■ ■ 

BRIEFING 

89 

96 

108 

96 

96 

70 

81 

89 

97 

107 

0-  CARREL 

43 

40 

68 

40 

68 

78 

84 

110 

50 

60 

1 - FAMILIARIZATION 

31 

43 

48 

43 

48 

2 -PROCEDURES 

363 4 

403 

403 

403 

403 

81 

84 

86 

40 

50 

3 _ part-mission 

29 

37 

48 

37 

37 

24 

35 

50 

50 

65 

4 - FULL-MISSION 

21 

21 

21 

21 

21 

21 

21 

21 

21 

21 

B1 

27 

27 

33 

27 

27 

21 

21 

21 

21 

21 

TOTAL 

276 

304 

366 

304 

337 

301 

326 

377 

279 

324 

'’typical  source  of  trainees 
Preliminary  estimates  only 
Includes  2 hours  in  device  2/oso 


The  recommended  Proficiency  Maintenance  Training  (PMT)  course 
requires  each  Main  Operating  Base  (MOB)  to  be  fully  equipped  with  all  devices 
(including  air  vehicles)  needed  to  maintain  combat  readiness.  For  each  crew 
member,  this  training  requires: 

8 hrs  - Device  0 

6 hrs  - Device  2 (1-hour  sessions) 

6 hrs  - Device  3 (2-hour  sessions) 

6 hrs  - Device  4 (one  2-hour  and  one  4-hour  session. ),  plus 
one  5-hr  training  flight. 

The  economic  analysis  of  the  recommended  instructional  system 

assumed : 

1)  a single  CCTS  (as  described  above) 

2)  PMT  at  each  MOB  (as  described  above) 

3)  6 MOB  (30  UE)  and  1 MOB  (15  HE)  co- located  at  the 

CCTS  (additional  15  UE) ; total  of  210  air  vehicles  to  be  manned 

4)  crew  ratio  of  2.0 
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5)  attrition 

ratio  of  30%  per  year  (50% 

for  copilots  due  to 

upgrade) 

6)  alert  rate 

assumed  to  be  0.6  for  the 

purposes  of  analysis 

')  trainee  sources  prioritized  among  projected  availability 

The 

numbers  of  each  device  to  support  the  recommended  system  are: 

0 - 

carrel 

CCTS[l$ith  co-located 
MOB  (15  UE)  ] 

13 

MOB (30  UE) 
8 

1 - 

familiarization 

4 

0 

2 - 

procedures 

P/C 

2 

1 

OSO 

3 

1 

DSO 

2 

1 

3 - 

part-mission 

P/C 

2 

1 

OSO 

2 

1 

DSO 

2 

1 

4 - 

full-mission 

2 

1 

*- 
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r 
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.. 
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Life-cycle  costs  were  computed  for  the  10-year  period  starting  in 
1980,  plus  the  RDT$E  and  acquisition  costs  to  be  expected  before  1980.  The 
costs  for  the  recommended  B-l  Aircrew  training  system  are  detailed  in  Appen- 
dix A (Volume  2). 

Alternative  Considerations 

, . Parametric  sensitivity  s tud i es-  -were  -carried  out ‘for  severa 1 alternative 
considerations,  the  most  important  of  which  are  PMT  concepts,  crew  ratio, 
—and  basing  configurations. 

PMT  Concepts.  In  addition  to  the  recommended  PMT  concept,  three 
alternatives  were  considered: 

a)  Same  as  recommended,  but  two  training  flights  totaling  8 hours 
(to  correspond  to  the  current  operational  concept); 

b)  Part  and  Full-Mission  Trainers  located  only  at  a centralized 
base  (with  increases  necessary  in  the  time  in  those  devices 
and  in  airborne  time); 

c)  Airborne  training  in  lieu  of  any  training  in  Part  or  Full- 
Mission  Trainers  (increased  airborne  time,  but  reduced 
capability  for  the  practice  of  dangerous/critical  tasks) 


I 


xi 


?0”»hfofcJse  "c^th/nf5  are.reduced  ^ about  12%  for  case  "b"  and  by  about 
, uc>  ^the  life-cycle  costs  are  about  30%  higher  for  case  "a  " 

about  4J?  higher  for  "b,"  and  about  75%  higher  for  case  "c."  The  prime’ 

cost  driver"  m these  calculations  is  the  airborne  training  Squired. 

from  the  bSfli^e  ^"^clS^th 

iff  half61"  0t  CreWS  trained  is  directly  proportional  to  the  crew  Stio  ° 


. Configurations.  A variety  of  MOB  configurations  were 

investigated  ranging  from  5 MOB  to  13  MOB,  using  initLl^nve^meJ 11  ,u 

variationSS6  >^1?a-°r  °f  differences  among  configurations.  The  range  of 
variation  m initial  investment  costs  was  determined  to  be  only  9%  Bv 

nSSS4 5  S6  °f  tS  economies  that  are  obtainable  using  the  PNfT  Sari  at  ions 

kent C:?  Iali;f10n)<  il  WOUld  be  exPect*d  ^at  the  variation  in  cost  can  S 
kept  within  the  same  range  for  any  other  basing  configuration. 

Conclusions 


S findi"8S  ““  aCC°"Pllsh"e«S  — ’ ^ ft-  the 


1.  The  equipment  state-of-the-art  is  not  exceeded  in 
any  of  the  training  device  requirements. 

2.  By  selecting  a spectrum  of  training  devices 
that  differ  from  each  other  in  capability  and 
corresponding  cost,  the  ground-based  training 
has  been  optimized,  while  the  use  of  airborne 
training  has  been  minimized. 

3.  Economic  modeling  techniques  indicate  that  the 
total  system  costs  are  sensitive  to  crew  ratio 
and  PMT  centralization  concepts,  while  basing 
configurations  are  relatively  insensitive. 

4.  A B-l  aircrew  training  program  is  recommended 
that  meets  rigorously  documented  training 

requirements,  and  accomplishes  that  at  least 
cost . 
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Section  I 


INTRODUCTION 


1.1  OBJECTIVE 

The  problem  of  determining  the  information  a person  must  be  taught 
in  order  to  perform  his  assigned  duties  adequately  has  plagued  training  spe- 
cialists since  the  beginning  of  formal  instruction.  Only  recently  has  a 
methodology  evolved  that  utilizes  the  techniques  of  systems  analysis  to  assure 
pertinency  and  completeness.  This  methodology,  termed  a Systems  Approach  to 
Training  (SAT),  has  had  a definite  impact  on  both  civilian  and  military  train- 
ing programs.  The  terms  Instructional  System  Development  (ISD)  and  SAT  are 
often  used  synonymously,  although  there  is  a distinction  made  between  the  two 
terms  in  this  program.  The  definition  of  ISD,  as  given  by  Air  Force  Manuals 
50-2  (1970)  and  50-58  (1974)  is: 

"A  deliberate  and  orderly  process  for  planning  and  developing 

instructional  programs  which  insure  that  personnel  are  taught 

the  knowledges,  skills,  and  attitudes  essential  for  successful 

job  performance."  (p.  1-1) 

SAT  applies  the  techniques  of  systems  analysis  to  ISD  in  order  to 
more  fully  ensure  that  the  entire  training  system  is  considered,  including 
interactions  with  time  and  external  constraints.  A major  feature  of  SAT  is 
a simulation  model,  the  Training  Resources  Analytic  Model  (TRAM),  which  is 
used  to  evaluate  alternative  training  systems  with  respect  to  itemized  and 
total  cost,  time  phasing  of  trainee  graduation,  and  time  phasing  of  resource 
requirements . 

In  the  B-l  SAT  task,  AFM  50-2  Instructional  Systems  Development 
(1970)  was  taken  as  the  point  of  departure  for  a comprehensive  study  of  fac- 
tors involved  in  the  concept  of  Instructional  System  Development  (ISD).  In 
this  analytical  study,  Calspan  enlarged  upon  the  established  ISD  process  by: 

1.  conducting  a review  of  all  pertinent  past  and  current  research; 

2.  conducting  a current  and  predicted  state-of-the-art  review  of 
flight  and  systems  simulation; 

3.  developing  a Sorting  Program  to  allow  for  the  computer  storage, 
retrieval,  and  updating  of  the  task  analysis  data  base; 

4.  developing  a Training  Resources  Analytic  Model  (TRAM)  to  per- 
form comparative  analyses  of  alternative  candidate  systems 
resulting  in  the  selection  of  the  optimal  training  system 
alternative,  based  on  externally  imposed  constraints  and  cost/ 
schedule  factors. 


vided  to  ‘vJh^-Tsro  lnSar“ik°"a:al  da“  Pro- 

translated  into  computer  acceptiblj  ?ormt  and  stored  Wer°  subsetlueml>' 
base  In  t-ho  r i cat  p f rormac  and  stored  as  a computerized  data 

SS5SC  sa-S.SaS-^Sar 
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analyses  conSjerlnf  t™M}£  Model,  was  used  to  conduct  trade-off 

ber  ' I 0 8t  h e“"y  constraints  of  external  influences , such  as  num- 

tr  . air  vehicles  to  be  manned,  expected  crew  member  attrition  airborne 

=8t^ 

1-2  ADVANTAGES  IN  TilE  USE  OF  SAT  METHODOLOGY 

integrity^  thin  “"iuncti'o" with'Se^urse  sjnab?8 

and  facilities)  win  ^ ^ 

? 3 

Utilizing  themrratl0n  leduci^  the  "unnecessary”  information  and  efficiently 

™ m ~;h^r“L:rs^r results  in 


2 


1.3 


LIMITATIONS  OF  THE  SAT  METHODOLOGY 


Although  the  development  of  the  SAT  methods  is  an  important  advance 

;«S81nSth^0lT:  SAT  iS  "0t  a panacea  for  a11  trainin^lop^  a - 

a Meksiof  aid"  to  “Y rith"  that  'YitS  °Ut"  anSKers-  SAT  is  si"Pl/ 

■an.R  H is  Y.  Y documenting  and  presenting  the  information  to 

vn?vS  ^ lu  ® 1 the  SAT  Process  establishes  the  potential  trade-offs  in- 
volved and  the  relative  costs  and  pay-offs  of  these  trade-offs  It  is  this 

funds'"  AsninPthet1Ch  BfMgers  mufJ  make  decisions  involving  expenditure  of 

is  ob^iollv  n nt  a eSf  ntlall>'  a11  decisions  managers  must  make,  there 

obviously  not  one,  and  only  one,  solution  to  the  question. 

. . °ne  of  the  Primary  problems  faced  in  developing  training  systems  is 

tem  la?  hf , ?uan^ltatlve  relationships  among  the  factors  that  affec/the  sys- 
tem  Probably  the  most  obvious  area  of  insufficient  quantitative  information 

iarfons  t1  Ve  ^ainin8  effectl veness  (transfer  effectiveness  ratios)  of 
Another  S&i. 

lack  of  quantitative  data  affects  the  SAT  process  in  that  ouan 

T\lhn  t ^ u,are  fqUired  as  inPuts  f°r  the  systems  analysis  aspects  o/sAT 

ma^erUwfohra  cof-  ^ ^ SAT  methodology,  it  provides  the  decision-* 

qualitative^  that a™  a assumPtions  (both  quantitative  and 
qualitative)  that  must  be  considered  when  developing  a training  system. 

1.4  ADVANTAGES  AND  DISADVANTAGES.  SPECIFIC  TO  THE  B-l  SAT 

- . a 8-1  SAT  Pr°gram  is  the  first  time  an  instructional  system  was 

still  maJ°r  F°rCe  weaP°ns  system  while  the  weapon  system  is 

iH  m development.  The  lead  time  that  is  provided  makes  it  possible  to 

m 6 training  device  requirements  on  the  basis  of  training  require- 

ments (curriculum)  rather  than  retrofitting  the  curriculum  to  utilize  pre- 
viously procured  hardware.  Therefore,  specification  of  training  devices  is 

andhscheduledCder1Ve‘  ^ also.allows  sufficient  time  for  device  development 
training  ^ traiIUng  deviCGS  when  th^  are  n^ded  to  beginP 


ti.  Another  advantage  encountered  in  carrying  out  the  B-l  SAT  program 
was  the  similarity  of  the  operational  mission  to  the  one  currently  existing 
for  operational  air  vehicles  (B-52  and  FB-111).  Due  to  the  similariS  of  the 
tke  B-2  and  the  B-52  and  FB-111,  Subject  Matter  Experts  (SMEWe 
availabie  and  were  included  on  the  team  that  developed  the  task  analysis  In 

wiS  FBnlllSandeR°s?UtS  °f  ^ SAT  pr°CeSS  W6re  developed,  they  were  dLcu^ sec 
SStSc  PerS°nnel  tC  — thGir  USefulness  ^ the 

The  lead  time  provided  by  developing  the  training  system  during  the 
development  phase  of  the  air  vehicle  that  was  previously  mentioned  as  an 
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advantage  to  the  B-l  SAT  also  results  in  serious  disadvantages.  The  obvious 
limitation  is  the  lack  of  information  about  the  operational  air  vehicle.  Both 
the  lack  of  data  and  changes  in  the  data  pertaining  to  the  operation  of  the 
air  vehicle  system  affect  the  determination  of  crewmembers'  job  performance 
requirements.  This  difficulty  encountered  within  the  B-l  SAT  was  minimized 
by  frequent  interactions  with  personnel  from  Boeing,  Rockwell  International 
Strategic  Air  Command,  and  B-l  Systems  Program  Office  who  were  familiar  with 
the  B-l.  To  accommodate  the  changing  nature  of  the  behaviors  performed  by 
the  B-l  crew,  Calspan  translated  the  task  analysis  received  from  the  B-l  SPO 
into  a computer  acceptable  format.  Through  the  use  of  computer  manipulation 
and  storage,  the  data  can  be  accessed  and  altered  both  during  the  contract 
period  and  by  the  using  command  (SAC)  after  the  Calspan  contract  is  completed. 


An  area  in  which  data  were  not  available,  which  is  associated  with 
the  previous  problem,  is  that  the  task  analysis  data  provided  to  Calspan  repre- 
sented a success-oriented  mission."  That  is,  malfunctions  and  the  behaviors 
associated  with  them  were  not  included  in  the  task  analysis.  Calspan 's  solu- 
^°V°  is  Problem  was  to  derive  the  task  analysis  for  malfunctions  from 
tne  first  flight  manual  in  conjunction  with  the  "Mockup  Demonstration  of  Con- 
tingency Flight  Crew  Procedures"  (NA- 74-531)  and  the  "Human  Engineering  Data 
on  Attention  Getting  Devices  in  the  B-l  Flight  Station"  (NA73-340-17)  This 
approach  is  appropriate  due  to  the  fact  that  the  initiation  cues  for  the 
behaviors  are  primarily  provided  by  annunciator  panels  and  the  Central  Inte- 
grated  Test  System  (CITS)  and  the  correct  responses  are  of  a procedurized 
(checklist)  nature.  A related  deficiency  in  the  data  base  was  the  lack  of 
those  tasks  that  are  non-EWO  mission  oriented  (e.g.,  CONUS  air  regulations), 
o eal  with  this,  comparisons  of  the  B-l  system  were  made  with  other  SAC 
weapons  system  training  procedures. 


With  respect  to  the  systems  analyses  conducted  within  the  B-l  SAT 
process,  the  major  problem  was  in  making  realistic  assumptions  to  the  state 
o a fairs  several  years  in  advance  of  when  the  first  air  vehicle  is  delivered 
lo  accommodate  changes  in  parameter  values  as  assumptions  become  known  infor- 
mation, Calspan  developed  the  Training  Resources  Analytic  Model  in  which  para- 
meter values  can  be  altered  and  the  resulting  impact  on  the  training  program 
costs  and  time  phasing  can  be  evaluated. 


Although  the  SAT  methodology  is  not  a total  solution  for  training 
system  development  problems,  the  techniques  have  been,  and  are  being,  refined 
to  where  it  is  a very  useful  "tool"  for  training  program  decision-making, 
particularly  considering  the  problems  inherent  in  performing  a SAT  on  a 
'yet- to-be"  system,  the  documentation  process  of  SAT  is  a requirement.  That 
1w->  t^ie  ^ata  base  is  fluid,  the  assumptions  and  assertions  upon 

w ich  decisions  are  made  are  well  documented  and  communicable. 


Section  2 


METHODOLOGY  USED  IN  B-l  SAT 


The  SAT  process  is  comprised  of  a number  of  relatively  distinct 
steps.  The  number  and  titles  of  the  steps  varies  within  the  literature.  The 
following  list  illustrates  the  steps  and  the  sequential  order  of  performing 
those  steps. 

1.  Analyze  the  operational  mission. 

2.  Identify  behavioral  objectives. 

3.  Establish  the  training  device  requirements. 

4.  Develop  the  course  syllabi  and  student  management  structure. 

5.  Develop  courseware  and  hardware. 

6.  Train  the  instructor  personnel. 

7.  Implement  the  training  program. 

8.  Evaluate,  validate,  and  revise  the  program  on  a continuing  basis. 

The  Calspan  B-l  SAT  program  has  progressed  through  the  first  four  of 
these  steps.  The  detailed  flow  diagram  of  the  B-l  SAT  is  illustrated  in 
Figure  1. 

2.1  ANALYSIS  OF  THE  OPERATIONAL  MISSION  (TASK  ANALYSIS) 

2.1.1  Purpose  of  the  Task  Analysis 

The  goal  6vf  a Systems  Approach  to  Training  methodology  is  the  design 
and  development  of  a* training  program  that  is  valid  with  respect  to  the  job 
requirements  imposed  'by  the  mission  to  be  accomplished.  That  is,  all  of  the 
necessary  skills  and  knowledges  must  be  taught  while  ensuring  that  information 
that  is  simply  "nice  to  know",  although  not  necessary,  is  not  included.  The 
philosophy  behind  the  systems  approach  is  that  if  the  crew  does  not  operate 
upon  the  information,  it  is  not  necessary  for  them  to  learn  that  information. 
The  foundation  of  any  valid  training  program,  therefore,  must  be  an  objective 
data  base  that  encompasses  the  crew  members'  job  performance  requirements  in 
an  operational  (and  training  mission)  environment.  Developing  a crew  training 
program  on  such  a data  base  ensures  that  the  training  is  relevant  to  the  mis- 
sion, rather  than  training  simply  for  training's  sake.  Through  the  use  of  a 
mission-oriented  data  base,  the  most  cost-effective  training  program  can  be 
developed  by  reducing  unnecessary  time  and  resource  requirements.  Resources, 
particularly  in  the  form  of  costs,  are  reduced  by  the  specification  of  train- 
ing devices  that  are  completely  adequate  for  the  purposes  of  transfer-of- 
training,  while  ensuring  that  overly-complex  (costly)  devices  are  not  speci- 
fied. To  develop  the  necessary  data  base,  the  techniques  of  task  analysis 
(referred  to  as  skills  analysis  when  dealing  with  task  microstructure)  has 
proven  to  be  a useful  tool. 


n-  , , A taS?^  aaalysis  team  was  assembled  by  the  B-l  SPO  for  the  purDoses 

developing  the  format  of  the  analysis  and  actually  developing  the^ask 
analysis  oata  base.  The  team  was  comprised  of  representatives  of  the  Air 
nation^T  *esoa?*?  Lab°rat0ry'  Strategic  Air  Command  Rock^eU  Inler- 
This  nC*’/nd  tHe  B°eing  Company>  in  addition  to  B-l  SPO  personnel 

ference  on'Se  M sTe^fort?™1^  ^ ^ individually  aad  in  coi- 

2-1.2  Level  of  Detail  of  the  Task  Analysis 

The  levels  of  detail  used  in  the  B-l  SAT  program  consist  of: 

1)  mission  segments  (e.g.,  refueling),  (2)  functions  (e.g.,  rendezvous), 

(3)  tasks  (e.g.,  descent),  and  (4)  task  elements  (e.g.,  reduce  power).  The 
task  element  is  the  smallest  unit  of  behavior  which  is  either  perceptual- 
motor  or  cognitive  in  nature.  This  hierarchy  of  levels  of  detail  proved  to 
be  effective  for  collecting  task  analysis  data  for  the  purposes  of  developing 
a training  program.  A distinction  should  be  made  between  task  analyses  con- 
ducted for  the  purpose  of  developing  a training  system.  In  the  former  case, 
simple  actions  such  as  flipping  toggle  switches  can  require  considerably  more 
detail.  For  example,  the  time  required  to  move  from  one  switch  to  another 
as  implications  as  to  their  relative  location  when  one  is  designing  panel 
layouts.  However,  this  aspect  of  the  task  is  of  little  importance  (with  rare 
exceptions)  to  the  training  program  designer.  The  workspace  has  already  been 
human  factored  prior  to, the  training  specialist's  entrance  on  the  scene, 
and  the  movement  times  are  far  less  important  to  him  than  the  sequence  of 
events.  An  exception  to  this  arises  if  the  movement  times  influence  task 
loading  which,  in  turn,  impacts  on  the  training  requirements.  Therefore,  the 
level  of  detail  necessary  for  a task  analysis  for  training  program  development 
is  not  as  high  as  is  necessary  for  equipment  design.  In  fact,  many  SAT  pro- 
grams in  the  past  have  been  hindered  by  the  level  of  detail  used  (e.g  Air 
Force  Project  1710,  Clark,  1974).  S 


In  the  same  sense  that  the  task  analysis  can  be  too  detailed,  many 
ot  the  quantitive  techniques  of  systems  analysis  are  more  rigorous  than  use- 
ful. For  example,  operational  sequence  diagrams  (OSD)  entail  more  information 
than  is  necessary  for  training  system  design.  Two  aspects  of  an  OSD  are  im- 
por  ant,  however.  First,  a time  line  is  necessary  in  order  to  determine  task 
loading  and  sequencing  information.  However,  in  many  (in  fact  most)  cases 
the  exact  times  are  not  necessary,  due  to  the  fact  that  the  sequence  is  what 
is  ot  importance  and  that  most  missions  are  dynamic  in  nature.  The  second 
component  of  an  OSD  that  is  important  in  the  design  of  training  systems  is 
crew  interaction  (including  ground  radio  operators,  refueling  tanker  personnel, 
e c.).  This  information,  along  with  the  other  information  included  in  the 
task  analysis  data  base, is  discussed  in  the  next  Section. 

2-I-3  Task  Element  Attributes 


The  information  in  the  task  analysis  data  base  includes  the  descrip- 
tive titles  of  the  mission  segment,  function,  and  task.  In  addition,  the 
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attributes  of  the  smallest  unit  of  behavior,  the  task  element,  are  as  follows: 

• Task  element  title. 

• Task  element  number. 

• Operator. 

• Behavior. 

• Task  duration 

• Crew  interaction. 

• Previous  task  element. 

• Next  task  element. 

• Comments  Cca"tegox*i zed ) . 

The  task  element  title  and  number  are  simply  accounting  information 
which  allow  one  to  identify  the  element  and  equate  identical  task  elements 
that  occur  throughout  the  mission.  The  operator  is  the  crewmember  performing 
the  behavior.  The  behavior  describes  the  actual  activity  occurring  in  the 
task  element.  This  behavior  consists  of  stimuli  that  cue  the  operator  to  in- 
itiate an  action,  an  action  phrase  (e.g.,  push  the  throttles),  and  stimuli 
that  cue  the  operator  that  the  activity  is  completed.  A more  detailed  format 
utilized  for  the  behavior  attribute  is  discussed  in  the  next  Section. 

The  task  duration  corresponds  to  the  time  required  to  accomplish 
the  task  elements.  These  times  can  be  seconds,  continuous,  or  indefinite 
(depending  upon  the  configuration).  Crew  interaction  involves  communication 
or  coordination  between  the  operator  and  one  or  more  other  individuals  (other 
crew  members,  refueling  tanker  crew,  etc.).  Previous  task  element  information 
is  used  to  illustrate  the  functional  dependencies  among  task  elements.  For 
example,  the  task  element  that  results  in  electrical  power  being  available 
must  occur  prior  to  the  VHF  radio  being  used.  Note  that  the  previous  task 
element  does  not  necessarily  immediately  precede  the  present  task  element. 

This  information  corresponds  to  "functional"  sequences  rather  than  "temporal" 
sequences.  The  next  task  element  is  the  element  that  follows  (temporally)  the 
present  task  element.  This  information  is  utilized  in  developing  the  time 
line.  The  comments  are  supplemental  information  that  may  be  of  future  aid  to 
the  analyst.  Each  comment  is  categorized  as  to  which  one  or  more  of  the  task 
element  descriptors  to  which  it  applies.  The  comments  may,  therefore,  be 
screened  to  find  those  that  are  relevant  to  specific  components  of  the  task 
element  data. 

In  addition  to  the  core  information,  other  supplemental  information 
was  provided  by  subject  matter  experts  through  the  SPO  and  elsewhere.  Exam- 
ples of  the  types  of  supplemental  information  are  task  element  "difficulty" 
and  "criticality."  It  should  be  note'"  that  it  is  often  more  appropriate  to 
assign  these  values  to  composites  of  elements.  It  is  often  the  case  that 
difficulty  and  criticality  values  are  quite  different  when  elements  are  con- 
sidered in  isolation,  as  opposed  to  when  they  are  performed  either  concurrent- 
ly or  consecutively  in  rapid  succession.  These  values  are  assigned  to  the 
task  level  of  the  mission  analysis. 
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2.1.4 


Format  of  the  Task  Element  Behavior 


As  previously  discussed,  the  format  of  the  behavioral  attribute  of 
the  task  analysis  data  base  corresponds  to  the  stimulus-response  characteris- 
tics of  the  activity.  The  major  components  that  characterize  the  behavioral 
aspect  of  a task  element  are  as  follows: 

Initiation  Cue--Action  Verb--Control--Completion  Cue. 

The  initiation  cue  is  the  stimulus  complex  that  informs  the  operator  to  begin 
the  activity.  The  initiation  cue  consists  of  a Boolean  combination  of  rela- 
tional statements.  The  relational  statements  involve  a stimulus  "source" 
(e.g.,  control  or  display],  a relation  (e.g.,  equal  to,  greater  than),  and  a 
value  (e.g.,  "on",  3000,  "red").  An  example  of  an  initiation  cue  is:  Alti- 

meter - greater  than  - 10,000  feet  and  Mach  Indicator  - equals  - 1.7  mach. 

The  necessity  for  a Boolean  combination  results  from  the  fact  that  some  initi- 
ation cues  consist  of  various  situations,  any  of  which  could  be  met  ("or" 
statement),  or  all  of  which  must  be  met  ("and"  statement).  The  controls  and 
displays  are  elements  of  a catalog  which  are  described  in  Technical  Memorandum 
SAT-8.  The  catalog  is  used  for  verification  of  the  data  as  the  task  analysis 
information  is  entered  into  storage.  This  verification  allows  keypunch  errors 
to  be  detected,  as  well  as  checking  that  the  value  assigned  is  appropriate 
for  that  control  or  display. 

The  action  verb  is  selected  from  a standarized  vocabulary  of  terms 
(e.g.,  pull,  rotate,  and  align)  that  was  developed  as  an  adaptation  of  the 
work  of  Oiler  (1968).  The  action  verb  has  a correspondence  to  the  control 
which  is  operated  upon. 

The  next  component  of  the  task  description  is  the  control.  This  is 
the  grammatical  direct  object  of  the  action  verb.  These  controls  are  a subset 
of  the  entries  in  the  Control/Display  Catalog.  It  should  be  noted  that  it  is 
sometimes  the  case  that  a "display"  can  be  operated  upon  (e.g.,  monitor  the 
altimeter)  and,  therefore,  becomes  the  "control." 

The  completion  cue  is  of  the  same  form  as  the  initiation  cue.  In 
fact,  it  is  often  the  case  that  the  completion  cue  of  one  task  element  is  the 
initiation  cue  of  the  next  task  element.  As  with  the  initiation  cue,  the 
completion  cues  are  Boolean  combinations  of  relational  statements.  However, 
in  the  former  case,  there  is  only  one  conglomerate  cue;  whereas,  in  the  latter 
case  there  are  often  two  or  more  conglomerate  cues,  each  of  which  leads  to  a 
different  next  task  element.  For  example,  when  a decision  is  made  by  a crew 
member,  two  alternative  actions  (next  task  elements)  might  be  possible,  de- 
pending upon  the  information  upon  which  the  decision  was  based.  A more 
common  situation  is  the  case  where  one  completion  cue  represents  the  normal 
operation,  and  the  other  completion  cues  represent  corrective  actions.  The 
format  of  the  behavior  is  presented  in  Figure  2.  Figure  3 gives  an  example 
from  the  B-l  mission,  illustrating  the  task  element  behavior  for  setting  the 
wing  sweep  for  cruise  configuration. 
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Figure  3.  EXAMPLE  OF  TASK  ELEMENT  BEHAVIOR 


2.1.5 


Encoding  the  Task  Analysis  Data 


Because  of  the  vast  amount  of  data  involved  in  the  task  analysis  and 
its  expected  fluidity  over  time,  it  was  mandatory  that  a computer  storage  and 
retrieval  system  be  utilized.  There  have  been  recent  advances  in  the  use  of 
computers  to  store  and  manipulate  task  analysis  data  (Reardon,  1968;  Reed, 
1967;  Tulley , Meyer,  Oiler,  Mitchell,  Reardon,  and  Reed,  1968;  and  Whiteman, 
1965).  The  sorting  program  described  in  Technical  Memorandum  SAT-4  was  de- 
veloped for  the  purpose  of  verifying,  manipulating,  and  retrieving  the  task 
analysis  data.  The  forms  which  are  used  to  encode  the  task  analysis  data,  in 
preparation  of  being  keypunched  on  computer  cards,  are  described  in  Technical 
Memorandum  SAT- 7. 

2-1.6  Analyst/Data  Base  Interface  Capabilities 

The  rigor  that  is  necessary  to  impose  on  the  data  in  order  to  make 
it  computer-acceptable  can  be  a hindrance  to  both  the  training  program  de- 
veloper and  the  instructor  personnel  that  modify  the  program  as  modifications 
are  necessary  (e.g.,  new  systems  or  procedures  are  added).  To  circumvent  this 
restriction,  interface  capabilities  have  been  developed  to  allow  easier  inter- 
action between  the  training  analyst  and  the  computer  data  base. 

The  problem  first  arises  during  the  encoding  of  the  task  analysis 
data.  For  example,  for  the  B-l  air  vehicle,  the  term  Altimeter/Vertical 
Velocity  Indicator  is  used  as  the  name  of  one  of  the  displays.  Other,  more 
common  terms  that  define  the  same  display  (or  its  parts)  are  "altimeter," 
"vertical  velocity  indicator,"  "rate  of  climb  indicator,"  etc.  To  allow  the 
training  analyst  more  latitude  during  data  encoding,  a Display  and  Control 
Catalog  is  used  to  equate  these  terms.  This  capability  of  using  synonyms 
(including  jargon)  has  proved  useful  to  the  training  developers  and  it  is 
antic’ pated  to  be  useful  to  the  individual  instructor  personnel  during  future 
program  modifications.  In  addition  to  the  control  and  display  names  and  syn- 
onyms, the  following  descriptive  information  is  included  in  the  catalog: 

• Subsystem  (e.g.,  flight  controls,  weapons,  ECM) 

• Location  (e.g.,  lower-left  pilot's  panel) 

• Type  (e.g.,  lever-locked  switch) 

• Values  (values  or  ranges  that  the  display  or  control 

can  assume) 

• Categorized  Comments  (analogous  to  the  task  analysis 

encoding  format  in  which  comments  are  coded  as  to 
the  descriptor (s)  to  which  it  pertains) 

This  information  is  useful  in  developing  behavioral  objectives  based  on 
systems  (controls  and  displays).  The  sorting  program  can  retrieve  such 
information  as  "which  controls  and  displays  are  on  the  copilot's  panels." 

This  information  is  also  valuable  in  defining  training  device  requirements. 
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A second  interface  capability  involves  the  use  of  synonyms  for 
action  verbs.  An  Action  Verb  Thesaurus  has  been  developed  to  relieve  the 
analyst  of  the  necessity  to  memorize  (or  look  up)  the  action  verbs.  For 
example,  the  terms  "reply"  and  "respond"  are  synonyms  for  the  purposes  of  the 
task  analysis.  The  analyst  can  use  either  term  during  the  encoding  of  the 
data  or  utilizing  the  sorting  program,  and  the  computer  will  translate  it  into 
the  formal  name  (in  this  case,  "reply"). 

A report  format  of  the  Control  and  Display  Catalog  and  the  Action 
Verb  Thesaurus  is  available  to  assist  the  analyst  (Technical  Memorandum  SAT- 
8).  A listing  of  the  task  analysis  data  developed  utilizing  this  report  is 
included  in  Technical  Memorandum  SAT-7. 

2.1.7  Identification  of  Behavioral  Objectives 

2. 1.7.1  Transformation  of  Task  Analysis  Data  into  Behavioral  Objectives 

The  first  step  in  developing  the  behavioral  objective  is  to 
partition  the  totality  of  task  elements  into  behavioral  components.  These 
components  can  be  characterized  as  being:  (1)  maneuvers,  (2)  checklists, 

or  (3)  procedures  (memorized  checklists).  For  example,  in  the  case  of  the 
B-l  SAT,  the  total  mission  is  composed  of  34  maneuvers. 

The  first-cut  behavioral  objectives  are  developed  for  each  of  these 
behavioral  components.  The  sorting  program  is  used  to  determine  the  common- 
alities that  exist  among  the  task  elements  (e.g.,  which  task  elements  make 
use  of  a particular  control;  or,  when  is  the  aircraft  in  a particular  config- 
uration). To  determine  behavioral  commonalities  among  the  task  elements,  it 
is  necessary  to  first  determine  the  skills  and  knowledges  necessary  to  perform 
the  actions.  Skills,  as  defined  for  this  purpose,  refer  only  to  perceptual- 
motor  behaviors  which  require  coordination  and  timing.  Therefore,  a covert 
response  such  as  "calculation"  is  considered  as  being  a knowledge  because 
there  is  no  motor  aspect  to  the  operation.  Because  skills  are  composed  of 
overt  motor  responses  (actions),  the  action  verbs  (in  combination  with  the 
performance  limits)  define  the  skills  necessary  to  perform  the  task  element. 

A distinction  to  be  drawn  is  between  "simple  actions"  and  a skill.  A simple 
action  does  not  require  coordination  (e.g.,  flipping  a toggle  switch),  whereas 
a skill  does  (e.g.,  tracking).  Although  all  of  the  action  verbs  represent  a 
response,  it  is  obvious  that  most  of  the  responses  are  "simple  actions"  and, 
therefore,  are  in  the  trainee's  repertoire  prior  to  his  entering  the  training 
program.  Tracking  responses,  such  as  those  that  occur  during  instrument  land- 
ings and  aerial  refueling,  represent  one  of  the  most  complex  categories  of 
skills . 


In  developing  the  behavioral  objectives,  additional  effort  is  re- 
quired in  the  transformation  of  the  task  elements  into  knowledge  categories. 
The  categories  include: 
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1.  Identify  (vocabulary) 

2.  Recognize 

3.  Recall 

4.  Locate 

5.  Interpret 

6.  Calculate  (algebraic) 

When  the  skills  and  knowledges  are  analyzed  for  each  task  element, 
it  is  possible  to  compare  task  elements  to  establish  commonalities.  These 
commonalities  are  the  basis  for  synthesizing  across  elements  to  form  aggregate 
behavioral  objectives.  That  is,  if  the  pilot  is  required  to  determine  his 
altitude  during  both  cruise  and  landing,  it  might  represent  one,  rather  than 
two,  behavioral  objectives.  The  data  are  now  in  the  form  of  stimulus-response 
terminology  that  illustrate  the  skills  and  knowledges  necessary  and  the  pro- 
ficiency needed  to  accomplish  the  mission  which  is  the  Behavioral  Objective 
format. 

2. 1.7. 2 Behavioral  Objective  Format 


The  format  of  the  behavioral  objectives  is  illustrated  in  Figure  4. 
The  specific,  attributes  of  the  behavioral  objectives  are  as  follows: 

• Behavioral  objective  title. 

• Initial  conditions 

• Concurrent  behaviors. 

• Behaviors. 

• Performance  criteria. 

• Enabling  objectives. 

• Ancillary  objectives. 

• Operators. 

• Interactions. 

• Task  elements  accounted  for. 

• Objective  criticality. 

• Objective  difficulity. 

The  behavioral  obj ective  title  is  simply  a descriptive  identifica- 
tion. The  initial  conditions  illustrate  the  state  of  the  aircraft  prior  to 
conducting  the  objective  behaviors.  An  example  of  initial  condition  informa- 
tion is  that  the  vertical  velocity  of  an  aircraft  is  at  a particular  value 
prior  to  conducting  a level -off.  The  initial  condition  information  is  de- 
rived from  the  previous  task  elements  of  each  of  the  behaviors.  That  is,  the 
terminal  state  of  the  previous  task  element (s)  corresponds  functionally  to  the 
necessary  initial  conditions  of  each  of  the  behaviors  performed  within  the 
objective.  An  aspect  of  the  objective  that  also  has  an  impact  is  the  descrip- 
tion of  concurrent  tasks.  For  example,  during  a maneuver  of  initiating  a 
climb,  it  might  be  required  that  the  operator  maintain  a constant  heading. 

This  information  is  necessary  in  order  to  determine  the  difficulty  and  criti- 
cality of  the  objective. 
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The  behaviors  involved  in  the  objective  are  the  same  behaviors  that 
are  involved  in  the  task  elements  that  are  encompassed  by  the  objective.  In 
fact,  the  format  of  the  behaviors  is  such  that  they  can  be  printed  directly 
from  the  computer  in  report  form.  The  basic  components  of  the  behavior  are 
the  initiation  cue,  action  verb,  control  or  display  acted  upon,  and  the  com- 
pletion cue.  These  components  have  been  discussed  in  detail  in  Section  2.1.4. 

The  performance  criteria  that  must  be  met  to  successfully  perform 
the  objective  are  one  of  the  most  difficult  aspects  in  developing  a "valid" 
training  program.  The  limits  must  be  referenced  to  the  operational  mission 
and  reflect  "necessary"  criteria,  below  which  the  mission  is  hampered.  The 
obvious  key  to  the  problem  is  the  term  "necessary."  Although  there  is  an 
abundance  of  data  relating  to  basic  research  designed  to  determine  the  "capa- 
bilities" of  human  operators  for  various  tasks,  there  is  little  ( if  any)  data 
to  support  decisions  regarding  the  minimum  proficiency  necessary  to  accomplish 
the  assigned  mission.  With  this  in  mind,  the  best  solution  to  the  problem  of 
setting  performance  criteria  is  for  training  psychologists  and  Subject  Matter 
Experts  (SME) , who  are  familiar  with  the  mission  requirements  (task  analysis 
data),  to  establish  "appropriate"  criteria  based  upon  the  mission  requirements 
and  the  characteristics  of  the  human  operator.  The  performance  criteria 
decided  upon  then  constitute  the  criterion  reference  to  be  utilized  in  evalua- 
ting trainee  proficiency  levels.  Within  the  rhetoric  of  SAT,  this  is  referred 
to  a criterion  referenced  testing  (CRT).  The  feasibility  and  cost-effective- 
ness of  automated  performance  measurement  and  automated,  adaptive  training  is 
discussed  in  Section  3.3  and  in  Section  4.4  of  Technical  Memorandum  SAT-3. 

Enabling  objectives  describe  the  prerequisite  skills  and  knowledges 
necessary  to  successfully  perform  the  behavioral  objective.  These  abilities 
include  both  overt  and  covert  behaviors.  Examples  of  covert  behaviors  include 
calculations,  recall,  etc.  Coordination  is  an  example  of  an  overt  enabling 
objective.  Two  task  elements  considered  alone  can  give  a totally  different 
impression  than  the  two  considered  as  one  action.  For  example,  in  level-off 
maneuvers,  the  throttle  is  reduced  and  the  pitch  control  is  manipulated.  Each 
of  these  behaviors  is  relatively  easily  performed.  The  coordinated  combination 
of  the  two  that  results  in  a smooth  transition  from  climbing  to  level-off, 
without  over-or -under  shooting,  is  much  more  difficult.  The  purpose  of  the 
enabling  objective  is  to  make  explicit  the  abilities  necessary  by  synthesizing 
across  the  simple  actions  involved  in  the  task  data  base.  It  is,  therefore, 
an  elaboration  of  the  data  base  which  is  not  handled  adequately  in  stimulus- 
response  terms.  The  knowledge  necessary  to  accomplish  the  objective  is  a 
particularly  important  aspect  of  enabling  objectives.  This  knowledge  relates 
to  principles  and  concepts  that  are  necessary  to  perform  what  appears  overtly 
to  be  a simple  behavior. 

Ancillary  objectives  are  used  to  illustrate  information  that  the 
operator  needs  to  have  in  order  to  handle  abnormal  events.  The  B-l  task 
analysis  data  base  represents  a success-oriented  mission  and  does  not  address 
malfunctions.  Therefore,  in  addition  to  the  enabling  objectives  necessary  to 
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accomplish  the  successful  mission,  the  ancillary  objectives  are  necessary  to 
handle  malfunctions. 

The  operator  is  the  crewmember  that  performs  the  behavior.  Crew 
interaction  involves  the  other  crewmembers  that  the  operator  must  coordinate 
with  or  receive  information  from.  In  addition  to  the  crewmembers  on  the 
operator's  own  aircraft,  crew  interaction  includes  the  interactions  with  the 
groundcrew  (crew  chief,  carrier  radio  operators,  etc.)  and  crewmembers  of  other 
aircraft  (refueling  tanker,  etc.). 

The  task  elements  are  the  elements  that  the  objective  encompasses. 
When  all  objectives  have  been  written,  all  task  elements  within  the  mission 
must  be  accounted  for.  The  criticality  and  difficulty  are  subjective  evalua- 
tions that  are  scaled  from  one  to  three.  It. should  be  noted  that  the  diffi- 
culty and  the  criticality  of  the  composite  of  the  task  elements  can  be  greater 
than  any  of  the  task  elements  taken  individually.  The  type  and  number  of  con- 
current tasks  also  have  an  impact  on  the  difficulty  and  criticality  of  the 
objective.  An  example  of  a behavioral  objective  (without  specific  values)  is 
given  in  Figure  5. 

As  in  the  case  of  the  individual  task  elements,  the  behavioral 
objectives  may  be  thought  of  as  being  involved  with  one  or  mofe  behavioral 
categories,  although  for  behavioral  objectives  they  are  fewer  in  number  and 
more  globally  defined.  The  categories  that  are  relevant  to  this  program  are 
Perceptual  processes,  Mediational  processes.  Communication  processes,  and 
Motor  processes  (also  referred  to  as  perceptual -motor  processes).  The  category 
of  perceptual  processes  involves  primarily  detection,  recognition,  and  identi-* 
fication.  In  this  case,  there  is  little  or  no  interpretation  involved,  given 
that  the  stimulus  (cue)  is  not  masked.  Drawing  the  analogy  between  this  case 
and  the  "simple  action"  previously  discussed,  there  is  little  more  involved 
than  mere  orientation  necessary  to  be  able  to  accomplish  this  type  of  behavior. 
The  second  category  into  which  an  objective  can  be  classified  is  that  of  media- 
tional  processes.  This  category  involves  what  is  commonly  termed  as  problem 
solving  or  decision  making.  In  this  case,  more  complex  algorithms  are  involved. 
The  trainee  must  be  taught  the  complex  of  probabilities,  and  costs-and-payoffs 
involved  in  the  decision.  This  case,  therefore,  involves  the  presentation  of 
information  and  the  subsequent  information  processing.  The  third  category  is 
communication  processes.  This  category  involves  the  reception,  interpretation, 
and  transmittance  of  verbal  information.  This  category  is  obviously  a combin- 
ation of  the  first  two  with  the  restriction  that  verbal  material  is  being 
transmitted.  Although  this  is  true,  this  category  has  proved  useful  in  de- 
lineating the  instructional  requirements  for  the  objectives  developed  in  the 
B-l  SAT. . It  is  also  recognized  that  mediation  must  involve  perception  of  the 
information  to  be  processed  but  the  distinction  is  useful.  The  last  category, 
motor  processes , spans  a continuum  from  simple/discrete  movements  (simple 
actions^  to  complex/continuous  movements  (e.g.,  tracking). 

These  characterizations  have  obvious  implications  with  respect  to 
training  devices  that  are  required  to  teach  the  objective.  For  example,  many 
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OBJECTIVE:  MAKE  A COORDINATED  TRANSITION  FROM  CLIMBING 

TO  CRUISE  CONFIGURATION. 


INITIAL  CONDITIONS:  VERTICAL  VELOCITY:  2000 

POWER  LEVEL  100 
AIR  SPEEO:  .5 
ALTITUDE.  25000 
WING  SWEEP  16 
A V TRIMMED  FOR  CLIMB 

CONCURRENT  BEHAVIOR:  HEADING  REMAINS  CONSTANT 


TEMP.  AT  DESIRED  ALTITUDE  55 
DESIRED  POWER  LEVEL  90 
DESIRED  AIR  SPEED  .8 
DESIRED  ALTITUDE.  30000 
DESIRED  WING  SWEEP:  45 


INITIATION  CUE 

ACTION 

CONTROL  OR  DISPLAY 

COMPLETION  CUE 

BEHAVIOR: 

| ALTIMETER  = 29800 

| ADJUST  ] 

THROTTLES 

1 

POWER  LEVEL  IND.  = 90 

ALTIMETER  = 29600 

TRACK 

PITCH  IND 
CONTROL  STICK 

1 

1 

1 

PITCH  IND  * 0 
ALTIMETER  - 30000 

ALTIMETER  = 30000 
POWER  LEVEL  INO  * 90 

ADJUST 

WING  SWEEP  CONTROL 

1 

1 

WING  SWEEP  IND.  * 45 

ALTIMETER  = 30000 
AIR  SPEED  • .8 

ADJUST 

TRIM 

T 

1 

PROPRIOCEPTION  - NEUTRAL 

WING  SWEEP  IND  = 45 



1 

PRESSURE 

PERFORMANCE:  AIR  SPEED  = .8  (+  kts)  AT  CRUISE  ALTITUDE 

ALTITUDE  - 30000  (+  III  FROM  DESIRED  ALTITUDE  AT  CRUISE  (TIME  < sec). 
SUBJECTIVELY  SMOOTH  VERTICAL  FLIGHT  PATH  le  g REASONABLE  g FORCES). 
WING  SWEEP  = 45  (t  deg)  AFTER  ADJUSTMENT  (TIME  < sec). 

HEADING  ERROR  * 0 degrees  FROM  DESIRED  HEADING  U deg) 


ENABLING  OBJECTIVES: 


CALCULATE  NECESSARY  POWER  LEVEL  FOR  CRUISE  AIR  SPEED. 

: ALTITUDE,  TEMPERATURE,  DESIRED  TRUE  AIR  SPEED. 


CALCULATE  NECESSARY  ALTITUDE  TO  INITIATE  POWER  LEVEL  CHANGE. 

: INITIAL  VERT.  VELOCITY,  DESIRED  ALTITUDE,  AIR 
SPEED,  DESIRED  AIRSPEED,  A V CHARACTERISTICS 

CALCULATE  NECESSARY  ALTITUDE  TO  INITIATE  PITCH  CHANGE. 

: VERT.  VELOCITY,  DESIRED  ALTITUDE.  AIRSPEED, 

A-V  CHARACTERISTICS 


COORDINATE  THROTTLES  AND  CONTROL  STICK  TO  ACHIEVE  A RAPID 
TRANSITION  HAVING  THE  g FORCES  WITHIN  CRITERION 
WITHOUT  UNDERSHOOT  OR  OVERSHOOT. 


PREDICT  NECESSARY  PITCH  CHANGES  FOR  LEVEL-OFF  AT  DESIRED 

ALTITUDE  FROM  THE  VERTICAL  ACCELERATION  AND  THE 
RATE  OF  CHANGE  IN  PITCH. 

TRACK  PITCH  INDICATION  WITH  CONTROL  STICK  TO  REMAIN  AT 

ZERO  PITCH  AT  LEVEL  OFF. 

TRACK  HEADING  INDICATION  WITH  RUDDERS  AND  CONTROL  STICK 

TO  REMAIN  AT  DESIRED  HEADING  THROUGHOUT  MANEUVER. 


TASK  ELEMENTS: 


6.1 .1.1 

OPERATORS: 

PILOT  (AND  COPILOT) 

6.1 .1.2 

INTERACTIONS: 

DSO  PROVIDES  HEADING  DATA 

6.1 .1.3 

TIME: 

INDEFINITE,  DEPENDING 
UPON  CONDITIONS 

6.1 .1.4 

CRITICALITY: 

2 

DIFFICULTY: 

2 

Figure  5.  BEHAVIORAL  OBJECTIVE  ILLUSTRATING  A MANEUVER 


of  the  mediational  processes  can  be  instructed  using  very  simple  devices 
(static,  non- interact ive ) , whereas,  a complex/continuous  motor  process  requires 
a complex  device  (dynamic,  interactive)..  The  dimensions  along  which  training 
devices  vary  and  their  implications  for  device  selection  are  discussed  in 

^;5  of  the  Simulation  Technology  Assessment  Report  (Technical  Memoran- 
aum  oAl -3 J . 

2. 1.7. 3 Enabling  Objective  Hierarchy 

The  enabling  objectives,  as  defined  in  the  previous  section,  are  pre- 
requisite skills  and  knowledges  that  are  necessary  in  order  to  successfully 
accomplish  the  behavioral  objective.  The  question  then  arises  whether  the 
entering  trainees  possess  these  abilities  prior  to  their  entrance  into  the 
training  program.  If  the  objectives  can  be  performed  within  the  performance 
criteria,  instruction  (for  that  trainee)  is  not  required  as  a component  of  the 
training  system.  ^ 

r , A personnel  qualifications  catalog  is  a useful  tool  in  the  process 

of  documentation  and  subsequent  evaluation  of  the  trainee's  ability  to  accom- 
plish the  enabling  objectives.  The  personnel  qualifications  catalog  format 
that  was  developed  for  this  study  is  illustrated  in  Figure  6.  The  column  head- 
ings represent  the  sources  of  trainees  coming  into  the  training  program.  The 
rows  within  the  matrix  corresponds  to  the  control  and  display  systems  utilized 
in  the  aircraft  into  which  the  trainee  is  transferring.  The  matrix  is 

in„by  the  USe  °f  rating  scales  that  illustrate  the  incoming  trainee's 
previous  acquaintance"  with  the  systems.  The  ratings  and  their  definitions 
are  shown  in  Table  1.  An  example  page  is  illustrated  in  Figure  7. 

If  an  enabling  objective  is  already  in  the  trainee's  repertoire  of 
abilities,  the  enabling  objective  is  eliminated  as  being  of  concern  with 
respect  to  the  training  of  that  trainee  (or  group  of  trainees).  If  the  en- 
abling objective  is  determined  to  be  not  in  the  trainee's  repertoire,  it 
remains  in  the  training  program  and  becomes  a training  objective  in  its  own 
ight.  Therefore,  the  definition  of  a training  objective,  as  used  here,  is 
the  set  of  behavioral  and  enabling  objectives  that  are  not  already  in  the  in- 
coming trainee's  repertoire  of  abilities  and,  therefore,  must  be  trained. 

**  should  be  noted  that  an  enabling  objective  that  has  been  deter- 
mined  to  be  a training  objective  can  have  enabling  objectives  required  for  it. 
This  second  echelon"  of  enabling  objectives  is  then  evaluated  in  the  same 
manner  as  the  first.  If  it  is  not  in  the  trainee's  repertoire,  it  becomes  a 
training  objective  and  a "third  echelon"  is  developed,  and  so  on.  It  is  also 
possible  that  an  enabling  objective  can  be  "enabling  for  more  than  one  higher 
level  objective."  Figure  8 illustrates  a possible  system  of  objectives  with 
the  enabling  objectives  being  re-named  training  objectives,  if  they  are  not 
incoming  abilities.  7 

This  system  of  objectives  develops  into  an  objective  hierarchy  with 
each  successive  level  a prerequisite  of  the  next  level.’  Figure  9 illustrates 


18 


-lA~  •»' 


B-1  CONTROLS/DISPLAYS 


Figure  6.  INCOMING  ABILITY  MATRIX 


Table  1. 

CLASSIFICATION  OF  INCOMING  ABILITIES 

• A - PRESENTLY  USING  IDENTICAL  EQUIPMENT 

• B - PRESENTLY  USING  EQUIPMENT  WITH  IDENTICAL 

FUNCTION  BUT  DIFFERENT  OPERATION. 

• C - PRESENTLY  USING  EQUIPMENT  FOR  SAME  PURPOSE 

BUT  FUNCTIONALLY  DIFFERENT 

• D NEVER  USED  COMPARABLE  EQUIPMENT 


ITEM 

CONTROL 

DISPLAY 

CODE 

USING 

CREW 

MEMBER 

FB 

P 

-111 

N 

FLIGHT  CONTROL  STICK 

SI-1 

P-CP 

A 

SCAS  PITCH  SWITCH  FLIGHT  TEST  ONLY 

SI-2.1 

(P)-CP 

C 

SCAS  ROLL  SWITCH  FLIGHT  TEST  ONLY 

SI -2.2 

(P)-CP 

C 

SCAS  YAW  SWITCH  FLIGHT  TEST  ONLY 

SI -2.3 

(P)-CP 

C 

STICK  SHAKER  SWITCH 

SI -2.4 

(P)-CP 

B 

STANDBY  PITCH  TRIM  CONTROL 

SI-3.1.1 

P 

C 

YAW  TRIM  CONTROL 

SI-3.1.2 

P 

C 

STANDBY  PITCH  TRIM  CONTROL 

SI-3.2.1 

CP 

C 

YAW  TRIM  CONTROL 

SI-3.2.2 

CP 

C 

TRIM  FOR  TAKEOFF  SWITCH 

SI -3.2.3. 1 

(P)-CP 

c 

TRIM  FOR  TAKEOFF  LIGHT 

SI-3.2.3.2 

P-VP 

C 

PITCH  & ROLL  TRIM  CONTROL 

SI -3.3 

P 

A 

PITCH  & ROLL  TRIM  CONTROL 

SI-3.4 

CP 

A 

PITCH  TRIM  SWITCH 

SI-4.1 

P-CP 

C 

ROLL  TRIM  SWITCH 

SI-4.2 

P-CP 

C 

yaw  TRIM  SWITCH 

SI -4.3 

PCP 

C 

PITCH  AUGMENTATION  SWITCH 

SI -4.4 

P-CP 

C 

ROLL  AUGMENTATION  SWITCH 

SI-4.5 

P-CP 

C 

YAW  AUGMENTATION  SWITCH 

SI-4.6 

P-CP 

c 

FLIGHT  CONTROL  STICK  DISCONNECT 

SI -5 

P-CP 

D 

Figure  7.  EXAMPLE  OF  PERSONNEL  QUALIFICATIONS  MATRIX 


BEHAVIORAL  OBJECTIVE  1 


(TRAINING  OBJECTIVE  * 1 1 


ENABLING  OBJECTIVE  1.1  (KNOWN) 
ENABLING  OBJECTIVE  1.2  (KNOWN) 
ENABLING  OBJECTIVE  1.3  - 


cl 


TRAINING  OBJECTIVE  " 2 


BEHAVIORAL  OBJECTIVE  2 (TRAINING  OBJECTIVE  ' 4) 


ENABLING  OBJECTIVE  (KNOWN) 
ENABLING  OBJECTIVE 


ENABLING  OBJECTIVE  2.1 
ENABLING  OBJECTIVE  2.2 


-►  TRAINING  OBJECTIVE  ' 5 
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Figure  8.  FORMULATION  OF  AN  ENABLING  OBJECTIVE  HIERARCHY 
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Figure  9.  RESULTING  OBJECTIVES  HIERARCHY 
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the  training  objective  sequences  determined  by  the  objective  system  (Figure  8) 
and  a schematic  representation  of  the  resulting  objectives  hierarchy.  The 
sequential  dependencies  of  the  objectives  has  implications,  with  respect  to 
the  instructional  block  sequence.  The  hierarchy,  in  its  entirety,  represents 
all  of  the  information  (skills  and  knowledges)  that  is  included  in  the  training 
program,  with  the  successful  accomplishment  of  the  operational  mission  being 
the  ultimate  objective.  The  sequential  dependencies  were  used  in  the  iterative 
process  of  defining  the  B-l  aircrew  instructional  block  sequences.  It  was 
found  that  the  hierarchy  was  much  "wider  than  it  was  high."  That  is,  because 
of  the  highly  automated  nature  of  the  B-l,  a large  number  of  instructional 
blocks  (each  a grouping  of  training  objectives)  are  not  directly  dependent  on 
preceding  blocks.  Furthermore,  the  formulation  of  a hierarchy  of  objectives 
within  each  block  was  beyond  the  scope  of  this  study, 

2. 1.7.4  Establish  Training  Device  Requirements 

The  development  and  implementation  of  an  efficient  training  device 
(media)  selection  process  is  an  important  component  in  the  design  of  any  large- 
scale  training  program  in  which  extensive  use  of  media  support  is  anticipated 
The  problems  inherent  in  the  specification  of  such  a process,  however,  are 
many,  as  evidenced  by  the  numerous  attempts  to  develop  a successful  selection 
model.  At  the  present  state  of  educational  technology,  any  method/media  se- 
lection technique  must  be  treated  not  as  the  answer  to  the  media  selection 
problem,  but  as  a supplemental  tool  for  the  training  systems  designer.  In 
using  a model  or  methodology,  training  specialists  must  be  aware  of  its 
attendant  strengths  and  weaknesses  and  use  the  model  accordingly. 

A number  of  attempts  have  been  made  to  simplify  and  improve  the 
process  of  training  device  selection.  Nine  such  attempts  are  reviewed  in  TAEG 
Report  No.  8 (Braby,  1973).  An  in-depth  examination  was  conducted  of  systems 
proposed  by  U.S.  Air  Force  manuals  50-2  and  50-58,  Bretz  (1971),  TAEG  (1972) 
Briggs  (1970),  Rhode  (1970),  Walker  (1967),  and  Boucher,  Gottlieb,  and 
Morganlander  (1973).  This  examination,  plus  an  examination  of  the  implications 
o the  TAEG  Report  No.  8,  indicate  that  an  optimal  device  selection  system 
must  contain  the  right  blend  of  expert  judgment,  combined  with  a systematic 
categorization  of  training  devices,  according  to  the  inherent  attributes  which 
efine  each  device.  Within  an  optimal  selection  system,  training  objectives 
should  also  be  characterized  in  terms  of  the  attribute  requirements  which 
training  environments  should  possess  to  teach  those  objectives.  By  matching 
attributes  of  the  training  environment  with  training  device  attributes, 
appropriate  devices  for  the  training  objective  can  be  selected. 

Such  a matching  approach,  tempered  with  expert  judgment,  has 
recently  been  operationalized  in  the  U.S.  Navy's  Training  Effectiveness,  Cost 
— fectiveness  Prediction  Technique  (TECEP)  (Braby,  Henry,  and  Morris,  197T). 

The  TECEP  was  derived  by  combining  features  from  a number  of  the  selection 
techniques  cited  above.  In  the  TECEP  approach  to  device  selection,  each  train- 
ing objective  is  categorized  as  one  or  more  of  16  categories  of  learning.  On 
the  basis  of  the  learning  category  identified,  learning  strategies  are  selected. 
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From  the  learning  strategies,  the  attributes  of  the  training  environment  for 
a training  objective  are  derived.  The  attributes  of  the  training  environment 
are  then  matched  with  the  attributes'  training  devices  to  select  the  candidate 
device  alternatives  for  each  training  objective. 

Guidance  in  formulating  the  B-l  training  device  selection  technique 
used  was  taken  from  the  TECEP  technique;  however,  due  to  the  mission-oriented 
nature  of  the  B-l  SAT  program,  several  changes  in  emphasis  were  instituted  so 
that  the  selection  technique  would  be  maximally  compatible  with  the  goals  of 
the  B-l  SAT  program.  The  training  device  selection  process  is  illustrated  in 
Figure  10. 


For  each  training  objective,  the  stimulus  cue  attributes  of  the 
operational  environment  in  which  the  objective  will  be  executed  are  identified. 
From  this  set  of  attributes,  those  stimuli  which  are  necessary  for  proper 
training  of  the  objective,  at  various  stages  of  training,  are  identified  and 
are  used  as  the  set  of  stimulus  attributes  against  which  potential  training 
devices  are  evaluated.  For  a detailed  discussion  of  the  attributes,  refer  to 
the  Simulation  Technology  Assessment  Report,  Technical  Memorandum  SAT-3. 

Media-trainee  interaction  requirements  for  each  training  objective 
are  derived  from  two  sources:  (1)  learning  guidelines  which  are  based  on  the 

kind  of  learning  inherent  in  each  training  objective  (e.g.,  recall,  continuous 
movement,  crew  coordination);  and  (2)  basic  principles  of  learring  which  are 
applicable  across  different  kinds  of  learning  (e.g.,  type  of  pacing,  knowledge 
of  result").  The  basic  established  principles  of  learning  and  guidelines  for 
learning  can  be  implemented  in  a system  that  includes  three  factors: 
individual  versus  group  setting,  self-paced  versus  instructor-paced,  and  linear, 
cycled,  or  branching  logic.  The  precise  specification  of  feedback  to  include 
content,  timing,  and  form,  and  the  specification  of  trainee  response  modes  can 
better  be  determined  within  the  context  and  environment  in  which  each  training 
objective  will  be  taught  and  tested  (criterion  referenced  tests).  It  has  not 
been  found  to  be  useful  in  this  program  to  consider  media  for  testing  inde- 
pendent of  training  media.  This  is  a consequence  of  the  emphasis  on  active 
participation  of  the  trainee  in  the  training  concepts  employed.  In  specifying 
these  attributes,  two  principles  of  learning  are  implemented  whenever  practi- 
cal: (1)  the  use  of  frequent  and  positive  feedback  and  (2)  the  use  of  active 

learning,  in  which  overt  responses  are  required. 

The  next  step  in  the  process  is  to  identify  candidate  devices  which 
possess  the  necessary  stimulus  and  interaction  attributes.  From  the  devices 
identified  in  the  matching  process,  that  device  which  is  the  best-suited  for 
the  training  objective  and  which  is  the  most  cost-effective  in  terms  of  initial 
purchase  and  maintenance  costs  and  in  terms  of  maximum  utilization  capability 
across  training  objectives  is  selected.  In  evaluating  the  impact  of  economic 
considerations  on  method/media  selection,  the  output  of  the  TRAM  assists  SAT 
analysts  in  determining  trade-off  relationships  among  various  media  combina- 
tions . 


I 


I 

I 

] 

I 

1 

1 

I 

I 

1 

1 


The  method/media  selection  process  should  not  be  carried  out 
independent  of  instructional  block  allocation  and  sequencing,  for  the  two 
processes  are  interactive.  Commonalities  among  the  devices  selected  for 
different  training  objectives  may  have  impact  on  instructional  block  alloca- 
tion, or  logical  groupings  of  training  objectives  into  instructional  blocks 
may  impact  on  the  device  selection  process.  Consequently,  the  device  selection 
process  must  be  conceived  as  an  interactive  component  of  the  overall  develop- 
ment of  instructional  blocks  in  which  SAT  analysts  may  exercise  different 
combinations  of  instructional  blocks  and  devices  in  order  to  develop  the 
training  program  that  is  optimal,  both  in  terms  of  speed  and  quality  of  learn- 
ing and  in  terms  of  cost-effectiveness. 

2 . 1 . 7 . 5 Development  of  Instructional  Specifications 

Structuring  and  Scheduling  of  Courses,  Tracks,  and 

Instructional  Blocks. 

The  primary  purpose  of  developing  the  hierarchy  of  objectives  is  to 
use  it  as  a tool  in  the  scheduling  of  individual  objectives  on  the  basis  of 
the  sequential  dependencies  involved.  However,  this  sequencing  of  objectives 
is  only  dictated  by  the  hierarchy  to  the  extent  that  there  are  dependencies. 

That  is,  in  determining  the  relative  scheduling  of  independent  objectives, 
other  considerations  must  be  taken  into  account.  For  example,  referring  back 
to  Figure  9,  there  are  three  sets  of  dependencies  (3-2-1,  3-2-4,  and  5-4). 

These  dependencies  illustrate  that  objectives  two  and  five  must  precede  ob- 
jective four.  It  does  r.ot  dictate,  however,  the  sequential  order  of  instruc- 
tion with  respect  to  objectives  two  and  five. 

There  are  three  basic  determinants  that  can  be  used  in  the  scheduling 
of  instruction,  two  are  pedagogical  and  one  is  pragmatic.  The  first  determi- 
nant is  the  sequencing  on  the  basis  of  the  dependencies  within  the  obj  ective 
hierarchy.  This  is  the  primary  determinant,  and  cannot  (with  few  exceptions) 
be  violated. 

The  second  determinant  is  the  concept  of  context.  In  the  case  of 
training  programs  for  combat  aircrews,  context  is  primarily  derived  from 
either  "systems"  or  "phase-of-f light"  information.  With  respect  to  aircrew 
training  involving  highly  motivated  and  talented  trainees,  there  is  an  instruc- 
tional advantage  to  introducing  the  system  (e.g.,  location  and  operation  of 
controls)  and  the  necessary  concepts  for  initial  interaction  with  the  system 
while  allowing  the  trainee  to  interact  with  the  hardware  as  soon  as  possible. 

It  is  well  known  that  active  participation  on  the  part  of  the  trainee  is  im- 
portant for  efficient  learning,  but  this  active  participation  must  occur  within 
the  correct  context  of  phase-of-flight  in  order  to  establish  a valid  framework 
of  associations. 
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The  sorting  program  has  been  utilized  extensively  in  the  determina- 
tion of  instructional  context.  For  example,  a particular  system  (control  or 
display)  may  be  utilized  in  many  different  mission  segments  (phases-of-f light) . 
The  sorting  program  allows  the  analyst  to  rapidly  search  the  data  base  (task 
analysis)  to  determine  all  of  the  task  elements,  and  therefore,  behavioral 
objectives,  that  involve  that  particular  control  or  display.  These  objectives 
can  then  be  analyzed  to  evaluate  the  commonalities.  The  decision  is  then  made 
to  group  the  objectives  on  the  basis  of  system  commonalities  or  not  to  group 
them,  whichever  results  in  stronger  phase-of-f light  context. 

The  third  discriminant  for  determining  the  scheduling  of  instruction 
is  resource  management . This  factor  is  pragmatic,  rather  than  pedagogical. 
Although  the  objective  hierarchy  cannot  be  violated,  resource  management 
(training  device  and  facility  utilization)  can  take  precedence  over  context 
considerations.  The  goal  of  the  SAT  process  is  the  development  of  the  most 
cost-effective  training  program.  TRAM  was  used  as  a tool  in  evaluating  the 
trade-offs  involved  between  resource  management  and  context. 

Upon  the  basis  of  these  three  determinants,  instructional  blocks  are 
organized  into  a course.  Instructional  blocks  are  groupings  of  training  ob- 
jectives based  on  the  objective  hierarchy,  as  well  as  context  and  resource 
management . 

For  any  particular  course,  there  can  be  a number  of  different 
sources  of  trainees.  These  sources  have  different  incoming  skills  and  knowl- 
edges. These  abilities  were  documented  as  described  in  Section  2. 1.7. 3.  The 
sources  are  subsequently  compared  for  their  homogeniety  within  and  among 
sources  and  are  compared  with  respect  to  whether  they  can  be  grouped  into 
tracks.  A track  is  a curriculum  determined  to  be  cost-effective,  due  to  mini- 
mizing the  inefficiencies  resulting  from  covering  material  redundantly,  or 
missing  information  not  already  in  the  trainee's  repertoire.  If  the  sources 
are  heterogeneous,  then  there  would  be  one  track  for  each  source. 

The  next  sections  describe  the  instructional  system  derived  by 
following  the  procedures  delineated  in  this  section.  The  preferred  instruc- 
tional system  which  is  the  prime  emphasis  of  the  next  chapters  is,  the  most 
cost-  and  training-effective  that  the  SAT  methodology  can  provide. 
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Section  3 

ANALYTICAL  FINDINGS 


3. 1 INTRODUCTION 

The  primary  products  of  this  B-l  SAT  study  are  the  syllabi  for  the 
courses,  functional  descriptions  of  the  proposed  training  devices  and  time- 
phased  costs  and  resource  requirements  (training  devices,  aircraft,  support 
personnel,  trainees,  and  facilities).  Detailed  descriptions  of  these  products 
are  incorporated  in  the  present  report;  however,  an  extensive  amount  of  sup- 
porting information  which  played  a central  role  in  the  SAT  process  up  to  this 
point  is  included  in  the  documents  listed  on  Page  i. 

Course  syllabi  of  the  preferred  instructional  system  are  described 
in  this  volume  for  the  Pilot:,  Copilot.,  and  Offensive  Systems  Operator. 

Included  are  Transition  Training  at  the  Combat  Crew  Training  School  (CCTS) , 
Proficiency  Maintenance  Training  (PMr),  and  Upgrade  Training  (copilot  to 
pilot).  The  Defensive  Systems  Operator  syllabus  is  presented  as  an  estimate, 
since  the  task  analysis  for  that  station  was  not  available  in  time  to  be 
included  in  the  study.  Also  presented  in  this  section  are  descriptions  of 
the  recommended  training  devices. 

The  next  section  will  provide  the  results  of  the  use  of  TRAM  (the 
Training  Resources  Analytic  Model).  These  Include  the  time-phased  resource 
requirements  for  the  preferred  instructional  system  and  alternative  systems 
based  on  alternative  input  parameters  and  any  supporting  sensitivity  analyses. 
Time-phased  costs  and  costing  assumptions  are  included  in  Technical  Memorandum 
SAT-1,  Appendix  A (unattached).  The  supporting  information  is  briefly  summar- 
ized in  the  following  paragraphs. 

3.2  SUPPORTING  INFORMATION 

3.2.1  Task  Analysis  Data  Listing 


As  discussed  in  Section  2,  the  first  step  in  the  SAT  process  is  to 
analyze  the  operational  mission  in  order  to  derive  the  graduating  trainee's 
job  performance  requirements.  The  data  used  as  a basis  for  the  task  analysis 
were  developed  by  a team  comprised  of  individuals  from  the  B-l  SPO,  SAC,  Rock- 
v«e!i  International,  and  the  Boeing  Company.  The  data  were  provided  to  C’alspan 
during  the  period  July  1974  to  January  1975,' , and  were  subsequently  encoded  in- 
to the  computer-acceptable  format  described  in  Section  2.1.5.  In  addition  to 
the  "success-oriented  mission"  data  provided  by  the  SPO,  Calspan  developed  the 
task  analysis  data  for  emergency  procedures  from  the  Flight  Manual  in  conjunc- 
tion with  the  "Mockup  Demonstration  of  Contingency  Flight  Crew  Procedures" 
(NA-74-531)  and  the  "Human  Hngineering  Data  on  Attention  Getting  Devices  in 
the  B-l  Flight  Station" ( (NA73- 340-17) . These  data  were  encoded  into  the  same 
format  as  the  normal  procedures.  The  use  of  these  documents  to  develop  the 
task  analysis  was  appropriate,  due  to  the  procedural  (checklist)  nature  of 
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handling  most  malfunctions.  A computer  report  of  the  task  analysis  data  for 
norma  and  emergency  tasks  is  included  in  Technical  Memorandum  SAT- 7. 

^ • 2 Analyst/Data  Interface  Capabilities 

The  task  analysis  resulted  in  a large  amount  of  data  that  reauired 
Section  2 1 !"an"Pulatlo;\  (approximately  1500  task  elements).  As  discussed  in 
the  T?  "8i  maniP“lation , and  outputing  of  these  data  required 

the  implementation  of  interface  capabilities  between  the  user  and  the  computer 
data  base.  These  interface  capabilities  include  the  Control  and  DisplayTa^a- 
log  described  m Technical  Memorandum  SAT- 8 and  the  Sorting  Program5 that  is 
described  in  Technical  Memorandum  SAT-4. 

3 • 2 . 3 Behavioral  Objectives 

As  discussed  in  Section  2.1.7,  the  task  analysis  data  base  was 
ana  yzed  to  determine  the  Behavioral  Objectives  that  the  trainee  must  be  able 
T^6  USt  °f  Behavioral  Objectives  for  the  B-l  crewmembers  fexclud- 
Thf  pit  defenS^.Ve  systems  operator)  is  given  in  Technical  Memorandum  SAT-2  1 
The  extensive  detail  contained  in  the  Behavioral  Objectives  is  expected  to 

e who  wm  deveiop  the  **  ^ 


3.3 


TRAINING  DEVICE  RECOMMENDATIONS 


One  important  product  of  the  B-l  SAT  program  is  the  determination 
, r?1IUng  device  requirements  based  on  training  objectives  as  a function  of 
the  phase  of  framing.  The  goal  of  the  B-l  SAT  was  to  develop  an  effete 

rsF- <*“  Mc^f.tssfViOM. 

veyed^'thSS^SSmentt^P°rh^^h^^^"Me^°r^^U^n^^”^  'prepared  ^hich^sux- 
veyed  the  engineering  and  behavioral  aspects  of  training  devices.  Thaf  report 

the  tralning  analysts  applied  in 

participation  of  the  trainee,  generally  termed  early  "hands-on"  learning  This 
l accompixshed  through  the  use  of  a spectrum  of  devices  in  which  the  complexity 

trJ! Satl-sC°5SlStent  fth  the  r^Uirements  of  the  students-  le^f  " 
training.  That  is  for  example,  the  complexity  required  to  instruct  a trainee 

on  the  location  and  operation  of  "knobs  and  dials"  when  he  is  first  introduced 

a system  is  much  less  than  the  complexity  required  when,  in  later  training 

dinrtionTas3^1^  ^ ^ ^ ^ in  a perceptual -moL™8’ 

The  second  principle  which  was  followed  in  determining  the  device 

was“evaluatedWfS  ^ eac^.  ^-ing  requirement,  the  minimum  cost  device 
was  evaluated  for  its  applicability.  The  burden  of  justification  rests  on 
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increasing  the  complexity  (cost)  of  the  device  required  to  train  the  objective. 
Through  this  sequential  evaluation  of  device  applicability,  in  terms  of  stimulus 
(cue)  requirements  and  instructional  strategy,  the  lower  complexity  devices  are 
utilized  to  the  greatest  extent  possible.  \ 

With  these  principles  in  mind,  along  with  the  engineering  and  behav- 
ioral state-of-the-art  in  training  devices  discussed  in  the  Simulation  Technology 
Assessment  Report  and  the  selection  procedures  described  in  Section  2. 1.7.4, 
nine  training  devices  are  recommended  for  the  B-l  Combat  Crew  Training  School 
(CCTS) . These  devices  span  a continuum  from  a relatively  low  complexity  carrel 
to  a highly  complex  integrated-crew  mission  trainer.  A functional  description 
of  these  devices  is  given  in  the  present  section.  Facilities  and  costs  are 
described  in  the  next  section  and  Appendix  A,  Vol.  2. 

The  terminology  used  within  the  training  community  when  referring  to 
various  training  devices  is  often  confusing  and,  in  many  cases,  misleading. 

The  best  example  of  this  confusion  is  the  often-used  term  "procedures  trainer." 
These  devices,  although  under  the  same  name,  span  a spectrum  of  complexity  from 
photographic  mock-ups  to  totally  interactive  cockpit  replicas.  Similarly,  what 
is  referred  to  as  a "full  mission  simulator"  within  one  training  program  is 
often  referred  to  as  a "part-task  trainer"  in  another  program.  There  is  pre- 
sently a trend  in  training  device  description  to  use  alpha-numeric  designations 
without  attempting  to  attach  "descriptive"  names.  This  approach  has  been 
adopted  within  the  B-l  SAT  program  to  ensure  that  the  device  name  is  not  mis- 
leading, although  descriptive  names  are  also  offered  in  this  report. 

The  nine  recommended  devices  were  arrived  at  on  the  basis  of  an 
iterative  process  that  involved  examining  the  training  requirements  of  tenta- 
tive groupings  of  behavioral  objectives  (i.e.,  instructional  blocks),  deter- 
mining the  applicable  media,  restructuring  instructional  blocks  to  achieve  a 
more  economical  media  selection  consistent  with  the  learning  strategy,  and  so 
forth.  Five  basic  types  of  devices  were  defined  as  indicated  in  Table  2 , 
and  are  designated  as:  Device  0;  Device  1;  Devices  2/P/CP,  2/0S0,  2/DSO; 

Devices  3/P/CP,  3/0S0,  3/DSO;  and  Device  4,  which  is  a coordinated  combina- 
tion of  Devices  3/P/CP,  3/0S0,  and  3/DSO.  Devices  0 through  3 significantly 
differ  from  each  other  in  complexitv  with  corresponding  differences  in  develop- 
ment and  0§M  costs. 

Devices  0 and  1 are  totally  independent  devices.  A group  of  Device 
2s  may  be  linked  by  voice  communications  only,  for  the  purpose  of  coordinated 
procedures  practice.  Device  4 provides  full  interactiveness  between  an  ensemble 
of  Device  3s,  including  limitations  on  each  other's  systems  that  may  be  imposed 
by  concurrent  use  or  by  equipment  malfunction.  As  such,  Device  4 is  signifi- 
cantly more  than  the  sum  of  Device  3s  and,  hence,  is  given  its  own  designation. 

The  trainee's  performance  will  be  recorded  for  instructor  feedback 
(on-line  in  Devices  2,  3 and  4),  as  well  as  subsequent  evaluation  and  modifica- 
tion of  the  training  curriculum.  The  performance  measures  and  corresponding 
formats  used  for  the  recording  systems  must  be  compatible  across  all  devices 
at  the  CCTS  and  the  Main  Operating  Bases  (MOB),  as  well  as  at  the  SAC  ISD 


J * 5uC1ullty  (e,g‘*  at  SAC  HQ  or  the  CCTS1  THc 

that  both  the  CCTS  training  and  the  continuing  r?-  retirement  is  to  assur< 
pilot  upgrade)  training  utilize  standard!  7fad  S aintaimng  proficiency  and 
necessary  for  adequate  evaluation  and. ^ Performance  criteria.  This  is 
training  system.  H eva^ation  and  subsequent  modifications  of  the  entire 


Table  2 

^"'\Trainee 

DEVICE  DESIGNATIONS 

Device 

P/CP 

oso 

DSO 

AI  1 

0 

A L L 

X 

1 

X 

2 

X 

X 

X 

3 

X 

X 

r~r~ 

4 

X 



— 

3.3.1 


Device  0 


.General  Purpose  Carrel  (All  Crew  Members) 


to  as  a general  pEr^ose  ^ generally  referre 

student- centered  individualized  instructing  ! Number  0 is  to  Provide 
active  manipulation  or  monitoring  of  controls  and  d1"13?  ^ d°eS  n0t  recluire 
It  incorporates  an  audio-visual  presentation  dlSplayS  by  the  trainee- 
a reduced  photograph  of  the  cockpit  layout °%a  WoI*sPace  for  writing,  and 
involves  a student. -paced  narrated  slide  nise  tai  i"^5^1  Presentation 
grammed  (i.e.,  without  branching  logic)  but  un  S*  ?n.ithat. ^lnearly  pro- 
he  linearly-programmed  attribute  is  recommended  di  ant'JniPiated  recycling, 
the  incoming  abilities  of  the  trainees  withi^ ^ ? to  the  homogeneity  of 
homogeneity  of  the  trainee  population  redoes  the  tcurpcul™l  This 

ness)  of  more  complex  instructional  stratetnoc  • frciency  (cost-effective- 
computer- ass  is  ted  instruction  (CAI)  The^se^f^0*^^  branching  and  even 
sole  purpose  of  including  real-time  f 3 Vlsual  presentation  for  the 

»ent  for  this  device,  the  clses  Thele  th'"' g' ' ?V  °r  fil->  ls  * require 
important,  the  pattern  can  be  repressed  b^'dfT’T1  pattern  of  is 

the  slide  presentation.  P " y dlscrete  real-time"  advances  of 
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. c . T^e  insf-ructional  features  of  this  device  include  a response  record- 

e'!'’  f°Ur  alter?atives)>  performance  assessment  (i.e.,  correctness 
choice),  and  progress  monitoring  via  computer-managed-instruction  (CMI). 

TJTtng/yStem  Can  be  a^multi-channel  or  multi-plexed  magnetic  tape  sys- 
tem  with  the  data  processing  (performance  assessment  and  CMI)  being  accomplished 
through  the  use  of  the  computer  capability  of  one  of  the  more  complex  devices 

associated  with  !iL°r  T associated  minicomputer.  A library  and  librarian  are 
associated  with  these  devices,  but  an  instructor  need  not  be  present,  although 
one  should  be  available  for  consultation.  ® 

The  instructional  features  provided  within  this  device  result  in 
increased  instructional  effectiveness.  A second  important  function  of  these 
features  is  for  the  continual  evaluation  and  modification  of  the  training 
curricuium  through  feedback  of  students*  progress  vis-a-vis  expected  progress. 
The  capability  for  this  evaluation  and  modification  is  incorporated  in  all  of 

^tJrfnntT8  1C6S  £ecommeaded  for  the  B-l  training  system,  as  previously 
noted  in  the  paragraph  preceding  these  descriptions.  P V 

3,3,2  Device  1 - Familiarization  Trainer  (Pilot/Copilot) 

H P1?  secoad  level  of  complexity  within  the  spectrum  of  trainers  is  a 

device  that  is  used  to  familiarize  the  pilot  and  copilot  trainees  with  the 
location  and  operation  of  cockpit  controls  and  displays.  Device  1 is  comprised 

theacontri?rr0n  ?f;.'hard:  and."soft"  mockuP  instrumentation.  For  example, 
the  controls  (excluding  the  primary  flight  controls)  are  actual  hardware  or 

IV iL ^Mb^?atl°n.,(whlCheVer  is  less  costl>0  that  results  in  approximately 
the  same  feel  as  the  operational  equipment.  The  meter- type  instruments  are 
dynamic,  but  with  simplified  (low  fidelity)  movements.  For  example  Sen  a 
h *•“««.  that.«»lt*in  ■ -ter  reading  that  incest. 

of  the  meter  ^ “l*11"  dcvlce  1,111  entail  a ballistic  movement 

final  • f the/ate  of  meter  movement,  in  addition  to  the  stationary 

in  nn*  81VGS  lnformatlon  t0  the  operator,  then  that  behavior  is  instructed 

in  one  of  the  more  complex  devices.  The  lights  and  lighted  legends  within  this 

them^  ThiV °Perable.(on-°5f^through  the  corresponding  switches  that  control 
that  * dr^nnf-  deV1Ce  ^Uf®t!?ien  practicing  procedures  (normal  and  emergency) 
that  do  not  require  high  fidelity  dynamic  interactions  (e.g.,  checklists) 

cvc.  . ^ °o V1ce  0,  Device  1 utilizes  a narrated  slide  audio-visual 
em  in  w ic  t e instructional  strategy  involves  linear  programming,  as 
opposed  to  branching  logic.  This  device  also  includes  a trainee  response 
system  that  is  used  for  subsequent  trainee  performance  assessment  and  progress 
monitoring.  Through  the  use  of  audio-visual  presentations  and  the  response 
system,  the  trainee  can  be  presented  with  a multitude  of  "situations."  For 
example,  a particular  malfunction  situation  can  be  illustrated  on  a slide 
frame  with  the  trainee  being  required  to  interpret  the  situation  and  manipu- 

he  c°atrols  ln  the  appropriate  manner.  Library  and  instructor  require- 
ments are  the  same  as  for  Device  0.  4 


3.3.3 


Device  2 - Procedures  Trainers 


3. 3. 3.1  Device  2/P/CP  Procedures  Trainers 

. . . Dev*ce  2/P/CP  is  ujied  to  practice  procedures  that  require  complex 

nteractions  between  the  trainee  and  the  equipment,  as  well  as  complex  inter- 
action among  the  components  of  the  equipment.  It  has  a work  station  for  both 
the  pilot  and  copilot.  This  device  is  totally  interactive  in  terms  of  normal 
and  emergency  Procedure  tasks  for  operations  both  on  the  ground  and  during 

& inciudes  the  totai  c°^iex  °f  system 

. Thf  instrumentation  in  this  device  involves  actual  operational  equip- 

kinesrLt^60^1  fabracatl0n  that  results  in  the  appearance,  dynamics,  and  R 

*bat  replicate  those  of  the  operational  air  vehicle.  Exceo- 
10ns  to  this  description  are  the  terrain  following  radar  (TFR) , the  forward-P 
looking  infrared  (FLIR) , and  the  threat  situation  display  (TSD) . The 
capability  of  Device  2/P/CP  does  not  include  flight  equation  calculations. 
Therefore,  the  TFR,  FLIR,  EVS,  and  TSD  presentations  are  not  interactive  in 
real-time.  Slide  presentations  can  be  displayed  on  these  displays  to  repre- 
sent particular  configurations  that  impact  upon  procedures. 


The  instructional  features  of  Device  2/P/CP  include  a slide  nrp^n. 
tation  that  includes  the  computer  control  of  the  slide  sequencing  (CAI)  The 

resp^nse^ssiss^r87  V1™}™5  Programming  of  malfunctions , automatic 
p nse  assessment,  and  subsequent  slide  presentations  (e.g.,  feedback  and 

remedial  information).  The  sequence  of  instruction  in  this  d^ice  is  both 
self-paced  and  automatically  tailored  to  the  individual  t-ainee  (i.e.  using 
branching).  As  an  example,  for  a particular  emergency  procedure,  the  pre- 
programmed malfunction  will  occur.  On  the  other  hand,  if  the  response  was 
not  satisfactory,  the  trainee  will  be  informed  of  the  correct  response  and 
the  same  malfunction  will  be  performed  again. 

j • in  tbe  case  of  Device  the  visual  slide  presentation  in  this 

device  can  be  used  to  supplement  the  instrumentation  provided  in  the  device, 
or  example,  the  Central  Integrated  Test  System  (CITS)  provides  information 
about  malfunctions  to  the  aircraft  's-back^tation  with  ?his  informal  b°L 

Tb  a7Gh  i-u  t 6 P1i0tu  by.tbe  Offensive  and  Defensive  Systems  Operators. 

rough  the  use  of  the  slide  presentation,  Device  2/P/CP  can  be  operated  inde- 
°f  the  back  station  training  devices  (description  to  follow).  In 
a ltion,  an  instructor  can  play  the  part  of  the  systems  operators  through 
the  Intercom  bystem  (ICS).  The  instructor  and  instructor's  malfunction  inser- 

2/pn/rpanel  are  colocated  Wlth  the  trainees'  station.  The  front  station  device 
/ / is  similar  to  those  currently  within  commercial  aviation  training 
programs.  s 
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3. 3. 3. 2 Device  2/OSO  Procedures  Trainer 

The  0S0  procedure  trainer  (2/OSO)  is  used  to  practice  navigation  and 
weapons  delivery  tasks  that  do  not  require  real-time  radar  presentations  or 
continuous  movements  in  space  (i.e.,  maneuvering  of  the  air  vehicle).  This 
device  is  totally  interactive  in  terms  of  normal  and  emergency  procedure  tasks 
for  operations  on  the  ground  (e.g.,  pre-flight  checks)  and  during  flight. 

A major  function  of  this  device  is  to  practice  interactive  navigation 
and  weapons  data  input  and  access  through  the  use  of  the  integrated  keyboard, 
CRT  displays,  and  navigation  panel  displays.  Another  us~  of  this  device  is  to 
practice  using  the  Central  integrated  Test  System  (CITS)  for  abnornfhl  operation 
procedures . 

As  in  Device  2/P/CP,  Device  2/OSO  utilizes  operational  equipment  or 
special  fabrication  tnat  results  in  the  appearance,  dynamics,  and  kinesthetic 
"feel"  that  replicate  those  of  the  air  vehicle.  The  only  systems  that  cannot 
be  operated  interactively  in  real-time  are  the  FLIR  and  attack  radar  presenta- 
tions. These  presentations  are  "canned"  with  video  tape  or  film  (e.g.,  16  mm) 
as  the  storage  medium. 

The  instructional  features  of  Device  2/OSO  are  the  same  as  in  the 
previously  discussed  Device  2/P/CP.  This  includes  branched  instructional 
strategy,  performance  assessment,  and,  as  with  all  of  the  devices,  computer 
managed  instruction  (CMI).  The  instructor's  station  is  also  comparable  to 
Device  2/P/CP. 

3. 3. 3. 3 Device  2/DSO  Procedures  Trainer 

No  training  analysis,  per  se,  was  performed  for  the  DSO,  but  in 
order  to  exercise  TRAM  and  carry  out  facilities  estimates,  a hypothetical 
set  of  devices  for  the  DSO  was  created.  It  is  certainly  not  clear  whether 
a Device  2/DSO  will  be  required  (perhaps  all  the  synthetic  training  for  the 
DSO  will  most  cost-effectively  use  only  Devices  0,  3 and  4);  but  if  it  is, 
it  will  probably  be  similar  but  not  as  complex  as  the  Device  2/OSO.  The 
B-l  SAT  analysts  conceive  it  as  using  computer- control led  branching  of  a 
slide  presentation  as  does  the  Device  2/P/CP.  Correct  keyboard  use  would 
result  in  appropriate  graphics -type  displays.  Error- occurrence  messages 
could,  as  one  possibility,  be  evaluated  by  the  trainee  by  comparison  of  his 
hard-copy  input  and  a displayed  correct  input.  In  this  manner,  the  DSO 
trainer  3/DSO  involves  interactive  passive  detection  data  and  readout  capa- 
bilities (including  the  integrated  keyboard),  as  well  as  a simulated  CITS 
panel.  Both  the  Threat  Situation  Display  (TSD)  and  the  Frequency  Spectrum 
Display  (FSD)  will  be  included. 

3. 3. 3.4  Device  2 Coordination 

The  purpose  of  these  devices  is  to  satisfy  the  training  objectives 
that  require  interactive  (man-machine  and  machine-machine)  capability  but  do 
not  involve  the  maneuvering  of  the  "air  vehicle"  or  trainee-controlled 
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alterations  of  the  radar  land-mass  presentation  (e.g.,  scale  changes)  as  in  the 
case  of  the  0S0.  These  devices  are  to  be  linked  by  communications  so  that  crew 
coordination  of  procedures  may  be  practiced  at  designated  points  in  the  curricu- 
lum. It  is  planned  that  a single  instructor  can  time  share  his  monitoring 
between  two  of  these  devices  when  at  least  one  of  them  is  operating  in  a totally 
programmed  (CAI)  mode. 

3.3.4  Device  3 - Part-Mission  Trainers 

3. 3. 4.1  Device  3/P/CP  Part-Mission  Trainer 


The  training  devices  that  have  been  previously  described  have  been 
progressing  from  a strictly  academic  device  (0)  to  a hands-on,  familiarization 
device  (1)  to  an  interactive  procedures  practicing  device  (2).  This  progression 
of  devices  is  consistent  with  the  progression  of  instruction  from  purely  cogni- 
tive, enabling  objectives  to  context  specific  orientation  and  then  to  perceptual- 
motor  skill  acquisition  through  practice.  The  skill  acquisition  that  occurs  in 
Device  2/P/CP  is  procedural  in  nature.  That  is,  the  behaviors  practiced  are 
sequential  patterns  of  discrete  responses,  as  opposed  to  continuous  (maneuver- 
ing) behaviors  that  require  both  timing  and  coordination.  This  latter  type  of 
behaviors  for  the  pilots  is  instructed  through  practice  in  Device  3/P/CP. 

The  phases  of  flight  that  require  an  extensive  amount  of  pilot's 
practice  in  perceptual-motor  tasks  are  (a)  take-off,  (b)  refueling,  (c)  manual 
terrain  following,  and  (d)  landing.  Device  3/P/CP  is  configured  for  the  train- 
ing of  the  objectives  relating  to  these  flight  phases.  The  training  objective 
instructed  within  this  device  involve  high  fidelity  cockpit  display  information 
and  precise  motor  control  that  requires  cueing  from  both  bodily  motion  and  an 
external  scene  representation  (e.g.,  aerial  refueling  contact). 

This  device  can  be  partitioned  into  eight  major  interacting  "com- 
ponents . " 

(1)  Cockpit  instrumentation 

(2)  Flight  equation  model 

(3)  Flight  control  system 

(4)  Sensor  systems  (FLIR  and  TFR) 

(5)  External  visual  scene  presentation 

(6)  Trainer  cockpit  motion  system 

(7)  Instructional  features  (performance  measurement) 

(8)  Instructor/Operator  station 

The  cockpit  instrumentation  component  consists  of  the  front  station 
controls  and  displays  excluding  the  FLIR  and  TFR.  The  simulation  of  these 
controls  and  displays  is  similar,  at  least  in  conplexity  of  simulation,  to 
many  military  and  commercial  aircrew  training  devices.  One  concern,  with 
respect  to  simulator  instrumentation,  is  whether  to  use  off-the-shelf  air- 
craft equipment  or  special  fabrication  ("simulated")  equipment.  The  primary 
advantage  of  using  aircraft  instruments  is  the  logistics  involved  in  repair 
or  replacement.  One  problem  with  this  approach,  however,  is  that  aircraft 
instrumentation,  while  designed  for  severe  environments,  is  not  capable  of 
withstanding  the  duration  of  utilization  that  is  required  of  training  device 
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equipment  (e.g.,  16  to  24  hours  per  day,  7 days  per  week).  This  trade-off 
between  aircraft  or  simulated  instrumentation  must  be  considered  on  an  instru- 
ment -by-instrument  basis  with  no  generalized  solution  being  possible. 

The  flight  equations  modeling  for  an  aircraft  such  as  the  B-l  is 
an  expensive  component  of  the  system  (in  both  computer  hardware  and  software) . 
The  modeling  involves  both  the  dynamic  structural  modes  of  the  air  vehicle, 
as  well  as  such  things  as  wind  gusts  and  shears,  ground  effects,  and  wheel 
strut  and  tire  friction  characteristics. 

With  respect  to  the  mathematical  modeling  of  the  structural  modes, 
a great  amount  of  guidance  can  be  derived  from  the  aircraft  design  tests  con- 
ducted on  Rockwell  International's  simulation  system.  However,  for  the  train- 
ing Device  3/P/CP,  it  is  not  necessary  to  include  the  outer  limits  of  the 
flight  characteristics  envelope  which  may  be  necessary  in  R§D  simulations  for 
air  vehicle  design  tests. 

Another  aspect  of  the  flight  equation  modeling  of  particular  impor- 
tance is  wing  sweep  characteristics.  It  is  possible  to  experience  cost  sav- 
ings by  utilizing  "high-fidelity"  modeling  of  only  selected,  discrete  values 
of  wing  sweep  (e.g.,  five  discrete  values:  j_5°,  20°,  25°,  45°,  67°).  Center- 

of-gravity  variation  is  another  area  in  which  the  full  range  of  values  is 
probably  inappropriate  and  where  selected  demonstrative  values  can  satisfy 
the  training  requirements. 

The  adequate  modeling  of  wind  gusts  and  shears  is  important  for  the 
practice  of  take-off,  aerial  refueling,  and  landing.  The  trainee  must  learn 
the  precise  control  required  in  these  tasks  and,  particularly,  to  be  able  to 
anticipate  the  effects  of  gusts,  shears,  and  ground  effects.  In  the  other 
phases  of  flight,  turbulence  is  merely  a disruption  that  increases  the  trainee's 
task  loading  and  does  not  require  precise  modeling. 

In  addition  to  the  modeling  of  wind  gusts  and  shear  effects,  Device 
3/P/CP  also  includes  "realistic"  modeling  of  ground  effects,  landing  strut 
characteristics,  and  tire  friction  (e.g.,  icy  runway)  during  both  take-off 
and  landing  roll,  as  well  as  during  flight.  These  capabilities  can  add  train- 
ing effectiveness  to  the  device  by  providing  "weather"  characteristics  that 
are  difficult  and  possibly  dangerous  to  obtain  with  the  aircraft. 

The  flight  control  system  (SCAS)  simulation  has  similar  considera- 
tions as  the  flight  equations  modeling.  In  the  case  of  SCAS,  it  is  important 
to  include  modeling  of  the  "possible"  malfunctions  that  can  occur.  That  is, 
it  is  not  necessary  to  simulate  all  of  the  possible  malfunctions  (and  combina- 
tions of  malfunction),  but  rather,  only  those  that  have  high  criticality  and 
probability  of  occurrence. 

The  sensor  systems  that  are  provided  to  the  pilots  are  the  forward- 
looking  infrared  (FLIR)  and  the  t_errain  following  radar  (TFR) . The  simulation 
of  FLIR  in  a real-time,  interactive  mode  is  a problem  that  strains  the  present 
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simulation  state-of-the-art.  It  is  difficult  to  assess  the  impact  of  FLIR 
simulation  on  terrain  following  flight  tasks.  The  FLIR  is  a secondary,  and,, 
therefore,  non-essential  system  for  operational  terrain  following.  In  addition, 
the  capability  of  pilots  to  extract  meaningful  information  from  the  FLIR  during 
high-speed/low  altitude  flight  is  questionable  due  to  the  velocity  of  the  flow 
pattern  involved.  Most  FLIR  training  can  occur  in  a non-interactive  mode  (e.g., 
FLIR  interpretation  and  target  detection);  hence,  real-time,  interactive  simu- 
lation of  FLIR  is  assessed  to  be  unnecessary  for  inclusion  in  this  device. 
Interactive  FLIR  training  can  occur  in  the  air  vehicle  without  increasing 
flight  time  since  the  training  is  short  in  duration  and  not  high  in  criticality. 
The  Navy  has  taken  this  approach  on  the  S-3A  anti  submarine  warfare  aircraft. 

If,  contrary  to  these  recommendations,  FLIR  is  simulated,  correlation  with  a 
visual  scene  presentation  is  required  to  ensure  that  inconsistencies  do  not 
occur  in  the  cues  provided  by  the  two  presentations. 

The  terrain  following  radar  is  basically  the  same  system  as  is  now 
being  used  in  the  FB-111  aircraft  and  simulator.  The  same  data  base  can  be 
used  for  the  TFR  as  for  the  attack  radar  (described  in  the  next  section).  For 
the  purposes  of  training  objectives  involving  manual  and  automatic  terrain 
following  when  the  pilots  are  independent  of  the  0S0,  a generic  ("simulated") 
terrain  data  base  is  sufficient,  as  opposed  to  "real-world"  terrain.  The 
characteristics  of  this  "simulated"  terrain  are  manipulable  and  result  in 
effective  training  (e.g.,  progression  from  easy  to  difficult)  that  is  diffi- 
cult to  obtain  with  "real"  data. 

As  discussed  in  the  Simulation  Technology  Assessment  Report,  the 
requirements  for  a visual  scene  presentation  are  not  very  well  understood. 
However,  there  are  two  factors  that  play  a major  part  in  determing  the  require- 
ments. The  first  factor  is  the  nature  of  the  task  with  respect  to  its  diffi- 
culty and  criticality.  In  the  case  of  the  B-l,  the  phases-of-f light  which 
require  visual  scene  presentation  are  take-off,  refueling,  and  landing.  Ano- 
ther phase-of-flight  in  which  external  visual  cues  can  assist  (but  are  not 
required)  is  during  terrain  following.  Visual  scene  presentation  for  terrain 
following  operations  is  discussed  later  in  the  context  of  visual  scene  simu- 
lation capabilities. 

The  second  factor  is  the  experience  level  of  the  trainee  population. 
That  is,  the  visual  simulation  required  to  instruct  undergraduate  pilots  is 
quite  different  from  that  required  to  transition  an  experienced  pilot  from 
one  air  vehicle  system  to  a similar  system.  In  the  latter  case,  only  a limited 
presentation  is  required  to  illustrate  the  differences  between  the  systems 
(e.g.,  touchdown  speeds  and  responses  to  control  inputs). 

For  the  purposes  of  satisfying  training  objectives  for  visual  land- 
ing and  take-off,  a limited-cue  presentation  is  sufficient.  Making  use  of 
the  training  objectives  and  the  Simulation  Technology  Assessment  Report  (STAR), 
the  appropriate  characteristics  of  the  visual  scene  simulation  are  as  follows: 
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Format 


Color 


Movement 


point  lights  system  (night-dusk  system  with  runway 
and  horizon  shading) 

limited  (represents  air  field  lighting,  and  refuel- 
ing boom  and  director  lights) 


Brightness  - 6 fL  (dusk  lighting) 
Interaction  - closed-loop 


- continuous 


Resolution  - 9 arcmin 


Range 


- 10  nm. 


I 1. 


Extent 


Field  of 
View 

Atmosphere  - 


Viewing 

Position 


(1)  take-off  - length  of  runway 

(2)  landing  - 10  nm  (V-shaped) 

(3)  aerial  refueling  - soft,  (observation  position) 

(1)  vertical  - 30  deg. 

(2)  horizontal  - 45  deg.  (for  each  of  two  displays) 

(1)  ceiling  - flat  (as  opposed  to  structured) 

(2)  RVR  - haze,  fog,  etc.  (see  range) 

(3)  clouds  - only  ceiling 

(4)  precipitation  - none 

correct  perspective  at  both  pilot  and 
copilot  locations 


Visual  simulations  with  comparable  characteristics  are  presently 
being  used  for  take-off  and  landing  instruction  in  both  military  and  commer- 
cial training  programs.  The  system  described  need  not  allow  for  circling 
approaches,  due  to  the  limited  operational  use  of  this  pattern  for  the  B-l 
air  vehide  and  the  expectation  that  the  fundamentals  of  such  maneuvers  are 
within  the  incoming  skills  and  knowledge  of  the  trainees. 

The  refueling  phase  poses  a problem  for  the  present  state-of-the- 
art  in  visual  scene  presentation.  It  is  not  presently  known  which  cues  are 
necessary  for  refueling,  other  than  the  director  lights.  It  is  the  case  that 
ifferent  pilots  use  different  cues.  Therefore,  an  approach  that  is  consis- 
tent with  the  SAT  philosophy  and  results  in  extensive  cost  savings  is  to 
fhoose,  the  cues  anci  train  the  pilot  to  refuel  using  those  cues.  This  approach 
is  apparently  effective  in  training  pilots  to  fly  in  formation,  which  is  a 
station-keeping  task  not  unlike  refueling.  When  the  pilot  practices  refuel- 
ing after  training,  the  additional  cues  that  he  adopts  assist  himj  however, 
mos_t  of  the  available  cues  are  not  necessary  for  "successful"  accomplishment 
of  the  mission"  which  is  the  only  truly  valid  criterion  of  device  effective- 
ness. For  example,  night  refueling  using  only  the  director  lights  is  a good 
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case  °f  the  "necessary”  cues  for  refueling  and  would  greatly  simplify 
the  functional  requirements  of  the  simulation.  Given  this  approach,  in  com- 

WltH  ^ e*pressed  optimum  of  the  simulation  manufacturing  industry 
(that  the  present  advances  in  the  "point-lights"  system  will  ensure  the  refuel- 
ing _ capability) , this  system  involves  a relatively  low  risk  of  satisfying  the 
training  requirements  and  is  therefore  recommended. 


n n . Fo5’  the  PurPoses  of  satisfying  training  objectives  during  terrain 
following,  the  operational  mission  of  the  B-l  dictates  that  the  associated 
maneuvering  be  conducted  in  either  of  two  ways.  One  is  with  no  external 
visual  references  (i.e.,  under  completely  IFR  conditions)  and  the  other  is 
with  a very  limited  visual  perspective  because  of  the  severely  restricted 
field-of-view  provided  by  the  thermal  flashblindness  protection  windows. 

^skn?hanrfW?nf0lltI!ing/n  IFR  COnditions  is  a considerably  more  demanding 
task  than  fiying  with  reference  to  outside  obstructions.  Therefore,  because 

of  the  simpler  task  when  flying  terrain  following  in  VFR  conditions  and  the 
limited  visual  perspective  seen  by  the  pilot,  it  is  recommended  that  no  visual 
simulation  be  provided  in  the  terrain  following  phase  of  training.  The  in- 

St^ate®y  15  tha*  on?e  the  trainee  achieves  criterion  performance 
r the  greater  demands,  he  will  adequately  perform  under  any  lesser  demands. 


The  primary  advantages  to  the  computer- generated  "point-lights"  sys- 
tem are  the  low  initial  cost,  relative  ease  of  retrofit,  fewer  facility  require- 
ments  (relative  to  terrain  model  systems),  and  ease  of  maintainability.  As 
with  all  of  the  components  of  Device  3/P/CP,  the  correlation  of  the  visual 
cues  as  presented  and  the  information  that  the  pilots  receive  from  other 
sources  (e.g.,  instruments  and  bodily  motion)  must  ensure  that  conflicting 
cues  do  not  arise.  6 


m The  next  component  of  Device  3/P/CP  is  the  cockpit  motion  system. 

The  term  notion  is  used  here  to  refer  to  bodily  motion^TS^o^TiE 
which,  as  defined  earlier,  corresponds  to  visual  inputs.  As  discussed  in  the 
cumulation  Technology  Assessment  Report,  there  is  much  more  emotion  involved 
with  motion  simulation  requirements  than  there  is  technical  information.  In 
tact,  to  a great  extent,  the  research  literature  is  deluged  with  studies 
intended  to  "prove  a point"  as  opposed  to  obtaining  valid  information  that 
is  usable  m defining  training  device  requirements. 


The  air  vehicle  operates  in  a six  degree-of- freedom  of  motion  environ- 
ment, three  rotational  and  three  ti anslational  (pitch,  roll,  yaw,  vertical 
heave  longitudinal  thrust, and  lateral  sway).  Each  of  these  degrees-of- freedom 
provide* the  pilots  with  additional  information  (real  or  illusory)  as  to  the 
air  vehrdie's^ motion  and  position.  This  is  evident  by  the  fact  that  a simulator 
is  easier  to  fly  (better  performance)  when  motion  cues  are  provided.  The 
problem  is  that  this  fact;  is  quite  independent  of  the  question  of  training 
transfer  effectiveness  of  various  motion  configurations.  In  fact,  it  is  often 
the  case  in  training  situations  that  making  a task  more  difficult  than  "real- 
life  results  in  more  effective  training  (particularly  with  respect  to  reten- 
ion).  As  to  this  date,  there  are  no  research  results  that  allow  one  to  make 
unquestioned  decisions  as  to  essentially  any  aspect  of  motion  requirement 
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recommendations  for  the  B-l  training  system.  Therefore,  the  recommendations 
described  in  the  present  section  are  a result  of  an  analysis  of  the  technical 
and  research  data  (the  Simulation  Technology  Assessment  Report)  and  personal 
communication  with  many  groups  within  the  simulation  community  (see  Appendix  B, 
Technical  Memorandum  SAT-1,  Vol.  3).  These  groups  include  both  military  and 
commercial  training  facilities,  military  and  civilian  research  laboratories, 
simulator  manufacturers,  and  military  operational  units. 

If  the  question  is  posed,  "is  motion  necessary?,"  the  answer  is 
"Yes  and  No! ' . The  position  one  must  adopt  when  establishing  minimum  (least 
costly)  training  device  requirements  is  that  the  lowest  complexity  is  assumed, 
with  additional  complexity  requiring  justification.  However,  there  are  logisti- 
cal and  economic  factors  which  also  Play  a part  and  must  be  considered  in  the 
process.  These  considerations  are  discussed  throughout  this  section.  Each 
degree-of-freedom  of  motion  will  be  discussed  in  the  context  of  meeting  train- 
ing objectives. 

Roll  acceleration  is  one  of  the  pilots'  motion  inputs  during  both 
perturbing  turbulance  and  normal  operations.  Roll  position  (bank)  and  roll 
rate  are  less  important  cues.  Roll  onset  cues  are  provided  primarily  by  cock- 
pit motion,  whereas  rate  and  position  are  provided  to  the  pilot,  primarily 
through  the  visual  channel  (instruments  and,  if  available,  external  scene). 

This  is  very  much  to  the  advantage  of  the  training  device  designer.  The  use 
of  washout-motion  illustrates  how  the  designer  capitalizes  on  the  human's 
"limitations'." 

Unlike  roll,  it  is  pitch  position  rather  than  pitch  acceleration 
that  is  particularly  important  in  the  B-l.  This  is,  to  a great  extent,  due  to 
the  distance  that  the  cockpit  is  in  front  of  the  air  vehicle's  center  of  gravity. 
Pitch  changes,  in  this  situation,  are  less  apparent  than  the  accompanying 
vertical  acceleration  when  the  air  vehicle  encounters  a pitch  change.  Simula- 
tor pitch  position  is  important  during  high  pitch  angle  climbs  to  provide 
correct  cue  correlation  between  apparent  gravity  and  the  "air  vehicles" 
attitude  as  presented  on  the  instruments  and  the  external  visual  scene. 

The  only  time  that  yaw  motion  is  an  important  cue  is  during  mal- 
functions such  as  hard-over  rudder  SCAS  failure  or  loss  of  engine  power 
at  low  speed  (e.g.,  take-off^.  The  acceleration  involved  in  these  situations 
is  relatively  low  (3  deg/sec  ; the  air  vehicle  yaws  13  degrees  in  the  first 
3 seconds).  This  acceleration  is  near  the  human  threshold  for  detecting  yaw 
acceleration  and  is,  in  fact,  below  some  of  the  yaw  threshold  values  that  are 
reported  in  the  literature  (see  a review  by  Clark,  1967). 

In  addition,  the  response  to  these  malfunctions  is  ballistic  in 
nature,  rather  than  precise  control  until  the  vehicle  is  retrimmed.  A third 
consideration  is  that,  at  low  frequency  inputs,  the  visual  simulation  can 
provide  the  necessary  cueing  (alerting)  function  for  these  situations.  For 
the  preceding  reasons,  as  well  as  the  low  difficulty  in  training  these  objec- 
tives, yaw  is  not  justified  as  a requirement  for  Device  3/P/CP  . 

As  previously  mentioned,  vertical  acceleration  (heave)  results  when 
rapid  pitch  changes  are  made  as  well  as  during  actual  rapid  altitude  changes 


39 


(e.g.,  terrain  following  and  turbulence.1)  For  this  reason,  heave  is  an  important 
cue  to  the  pilots,  as  well  as  introducing  a detrimental  environment  such  as 
encountered  in  turbulance.  Therefore,  heave  is  judged  to  be  a requirement  for 
Device  3/P/CP. 

Lateral  acceleration  is  primarily  experienced  in  the  same  situation 
as  yaw.  This  is  primarily  due  to  the  distance  between  the  cockpit  and  the  center 
of  gravity  of  the  air  vehicle  (viz.,  57.5  feet).  In  adopting  the  same  rationale 
as  previously  described  for  the  yaw  degree-of-freedom,  lateral  motion  does  not 
appear  to  be  an  important  cue  for  the  purpose  of  training.  Therefore,  the  lateral 
(sway)  degree-of-freedom  is  not  a requirement  for  Device  3/P/CP. 


The  last  degree-of-freedom  of  motion  is  longitudinal  thrust.  Take-off 
and  landing  are  the  two  major  phases  of  flight  in  which  thrust  is  a cue.  In 
discussing  the  lack  of  thrust  in  the  FB-111  simulation  with  SAC  personnel, 
elicited  comments  were  not  negative  regarding  the  training  effectiveness  of 
that  device  due  to  the  lack  of  thrust.  From  this  experience,  and  the  low 
criticality  of  thrust-cued  tasks,  thrust  is  judged  not  to  be  a requirement  for 
Device  3/P/CP. 

Making  use  of  the  training  objectives  and  the  STAR  document,  the 
characteristics  of  a motion  system  (range,  rate,  and  acceleration,  respectively) 
that  appear  to  satisfy  the  training  requirements  are  as  follows: 


Pitch 


+10  , -5  deg 
10  deg/sec2 
25  deg/sec 


Roll 


+10  deg 
10  deg/sec 
25  deg/sec^ 


Heave 


+ 1 ft 

0.3  ft/sec 
0.3  g 


Payload  - 10,000  lbs 


There  are  commercially  available  ("off-the-shelf")  systems  that  meet  these 
requirements. * 


* There  is  one  aspect  of  motion  system  (as  well  as  visual  system  re- 

quirements) that  is  important  from  a logistics  aspect.  It  is  advantageous  for 
the  Air  Force  to  have  standardized  equipment  for  logistics  purposes  (repair 
and  replacement  of  parts,  technician  training,  etc.).  Furthermore,  there  are 
essentially  two  categories  of  air  vehicles  in  the  Air  Force:  attack/fighter 
aircraft  and  bomber/cargo  aircraft,  each  of  which  has  different  visual  and  cockpit 
motion  requirements.  Therefore,  it  is  advantageous  for  the  Air  Force  to  have 
two  standard  motion  base  configurations.  One  of  these  systems  would  be  a six- 
degree-of-freedom  motion  base  to  be  used  in  fighter/attack  training  devices, 
while  the  other  system  would  be  a three  degree-of-freedom  motion  base  to  be 
used  in  bomber/  cargo  training  devices. 
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Other  forms  of  motion  cueing  that  do  not  involve  "cockpit"  motion 
are  the  g-seats  and  g-suits.  These  devices  can  both  accent  the  cockpit  motion- 
base  cues  and  provide  long-term  acceleration  (sustained  g).  These  devices 
are  presently  being  evaluated?  however,  their  effectiveness  has  not  been 
established.  Therefore,  pending  these  evaluations,  g-seats  are  tentatively 
recommended  for  Device  3/P/CP  for  the  purposes  of  terrain  following  during 
low  level,  high  speed  flight. 

The  instructional  features  required  within  Device  3/P/CP  are  primarily 
concerned  with  performance  measurement  and  assessment.  That  is,  this  device  is 
a "practice"  device  rather  than  a "teaching"  device.  It  is  used  to  train  the 
skills  involved  in  air  vehicle  control  which  are  tasks  that  require  coordinated 
perceptual-motor  behavior.  Before  entering  this  device,  the  trainee  should 
have,  within  his  repertoire  of  behaviors,  all  of  the  knowledges  (enabling 
objectives)  that  are  prerequisite  to  his  developing  the  skill  of  vehicle 
control.  Therefore,  the  primary  instructional  features  involve  automatic 
performance  measurement  for  both  on-line  and  summary  trainee  feedback,  as  well 
as  training  program  evaluation  and  modification  (see  discussion  preceding 
these  device  descriptions). 

Another  instructional  feature  involves  the  pre -programming  of  initial 
conditions,  situations  and  events.  Approximately  ten  different  phases-of-f light/ 
air  vehicle  configuration  initial  condition  settings  are  required  for  Device 
3/P/CP.  In  addition,  approximately  200  events  (e.g.,  malfunctions)  or  situations 
(e.g.,  air  or  ground  threats)  should  be  able  to  be  pre-programmed,  entered  on- 
line by  an  instructor,  or  a combination  of  these  two.  These  events  must  be 
capable,  of  being  programmed  on  the  basis  of  both  mission  elapsed  time  and  X,  Y 
coordinates  in  the  simulated  space.  The  real  complexity  in  the  simulation  of 
events  and  situations  is  in  the  software  logic  required  to  present  realistic 
situations  (e.g.,  combinations  of  malfunctions).  Therefore,  the  problem  of 
pre-programming  is  basically  "logical,"  rather  than  technical.  For  this 
reason,  the  pre-programmed  events  and  situations  must  be  amenable  to  change. 

Another  feature  which  is  presently  proving  effective  in  aircrew  train- 
ing is  a complete  flight  profile  record  and  playback  system.  The  trainee's 
performance,  along  with  the  entire  flight  profile, is  recorded  with  the  capability 
of  playing  back  the  previous  five-minute  interval.  This  capability  is  required 
for  both  instroctor  and  trainee  error  analysis. 

The  final  component  of  Device  3/P/CP  is  the  instructor /operator 
station.  This  component  is  obviously  closely  related  to  the  trainee  performance 
monitoring  and  assessment  capabilities  previously  discussed.  There  have  been 
major  advances  in  simulator  instructor/operator  console  design  in  recent  years. 
The  concept  of  a "room-full"  of  repeater  instruments  is  giving  way  to  compact 
CRT  alpha-numeric  and  graphics  capabilities.  This  latter  type  of  display  system, 
in  combination  with  general  prupose  and  special  function  keyboards  for  data 
acquisition,  allows  a large  amount  of  versatility  with  low  space  requirements. 
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3. 3. 4. 2 Device  3/OSO  Purt-Mission  Trainer 

The  primary  phases  of  flight  for  which  the  0S0  training  objectives 
require  high-fidelity,  real-time,  interactive  training  device  capabilities  are: 
high-level  navigation  (high  and  low  speed);  low-level  navigation  (high  and  low 
speed);  aerial  refueling;  high-level  weapons  delivery;  low-level  weapons 
delivery;  terrain  following;  and  instrument  landing  approaches.  The  training 
objectives  concerned  with  these  flight  phases  require  "high-fidelity"  landmass, 
navigation  systems,  and  weapons  delivery  simulation.  A term  that  is  often 
applied  to  devices  with  similar  capabilities  is  "avionics  trainer." 


|(  The  offensive  systems  simulation  for  the  B-l  can  be  grouped  into  six 

"component"  systems.  These  are: 

1)  Navigation  Systems  (e.g.,  inertial  and  doppler). 

2)  Attack  Radar  (e.g.,  landmass). 

3)  Stores  Management  System  (e.g.,  conventional,  nuclear, 
and  SRAM  weapons), 

4)  Central  Integrated  Test  System  (shared  with  DSO). 

5)  Logic  Trees  (integrated  keyboard) 

6)  Forward-Looking  Infrared. 

The  navigation  systems  in  the  B-l  are  essentially  the  same  as  those 
being  used  in  similar  SAC  air/vehicles  (e.g.,  FB-111).  Therefore,  the  simula- 
tion characteristics  used  in  the  FB-111  navigation  systems  appear  to  be  appro- 
priate for  Device  3/OSO. 

The  Strategic  Air  Command  (SAC)  mission  of  the  B-l  is  an  important 
consideration  for  the  radar  simulation  requirements.  The  corridor  of  operation 
for  a SAC  mission  is  relatively  small.  That  is,  for  an  EWO  mission,  the  "extent" 
(maneuvering)  allowed  laterally  and  in  altitude  are  well-defihed  in  that  the 
air  vehicle  should  be  on-track  and  should  maintain  the  desired  altitude  plus  or 
minus  a small  amount.  Performance  outside  of  these  limits  does  not  meet  the 
criterion  and  is  not  acceptable.  The  implications  of  the  restricted  corridor 
for  B-l  operation  is  that  it  is  costly  and  useless  to  carry  the  radar  landmass 
simulation  beyond  these  limits.  The  trade-off  to  be  made  in  this  situation  is 
to  provide  more  longitudinal  (track)  extent  at  the  expense  of  lateral  extent. 

Another  consideration  of  importance  in  radar  landmass  simulation  is 
the  placement  of  the  high  resolution  (landmass  data)  where  it  is  needed.  For 
example,  the  resolution  required  for  high  altitude  flight  phases  is  much  lower 
than  the  resolution  needed  for  low  altitude  flight;  however,  even  greater 
resolution  then  both  may  be  needed  in  the  target  area.  Great  savings  can  be 
obtained  by  analyzing  both  the  training  and  emergency  war  order  (EWO)  missions 
in  the  determination  of  the  needed  resolution  of  the  landmass  simulation.  The 
resolution  of  the  data  base  need  not  exceed  the  resolution  of  the  actual  radar 
system  with  the  appropriate  range  setting  for  a particular  phase  of  the  mission. 
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rehearsal,  the  use  of^generif' ^landmass  7 7^  7 ^ P3rtS  °f  EW°  mlssi™ 
mass  can  result  in  cost  savings  L ! (f d ”aPs>  rather  than  "actual"  land- 

Through  modeling  techniques  it  is  reducing  training  effectiveness, 

and  cultural  features  that  can  enhance ‘ S^le  to  pr°duce  appropriate  landmass 
radar  simulation.  A third  alternative  ±7  a traiadng  effectiveness  of  the  attack 
landmass,  in  which  selected  J combination  of  generic  and  actual 

mass.  Because  of  the  great  amount  of  a It  SuPerimP°sed  on  generic  land- 

ations  (much  of  which  is  irrelevant)  this^M^  i±S  C0Vered  durln8  B-l  oper- 
for  B-l  training.  “relevant),  this  third  alternative  has  great  utility 

i>  the  users'  ?UmtpL”J^?er°theh%S  d13"^8  “ata  baSe  8t0ra^.  One 
These  approaches,  their  respective  advflS^C°n  US6j  digital  computer  storage. 

the  Simulation  Technology  Assessment  Report  ’^sically^h  ar*  d±SauSsed  in 
there  recently  has  been  (and  H basically,  the  situation  is  that 

vestment  in  rLearch  and  deveSLnf ^ ^ y<  “f lnUe  t0  be>  a sl8nif leant  in- 
little financial  support  being  given  ^tSe^hot  £ada5  <““>  “1th 

the  state-of-the-art  in  digital  radar  lad  P °8raphic  approach.  As  a result, 
Of-the-art  in  photographic  tectaLua^  ls  advanced  than  the  state- 

for  Device  3/0S0.  q ‘ °r  these  reasons,  DRLM  is  recommended 

navigation  system,  is  presently^ ingSsimulatedagf^ 7 201:  8781:61,1  (SMS>>  as  with  the 
systems.  The  approaches  being  used  in  thesf  J •"“tively  in  other  air  vehicle 
for  the  Device  3/0S0.  S mubati°ns  appear  to  be  appropriate 

tion  information  to  the  ^®gyatad  Ta^®  System  (CITS)  tests  and  displays  malfunc- 

numerics  presented  on  Ca7Ze  Ray Tub^s (III)  rll  7^  llghtS  and  alPha~ 
lation  of  "malfunction  insertion  ..hI  f,',  real  comPlexity  in  the  simu- 
simulation  that  has  generaUv^  I f ^aiPulation"  is  one  of  the  areas  of 

of  malfunctions  requires  extensive  Inalysis^f  the^  a“anti°n>  The  simulation 
their  probabilities.  To  this  extent  t-L  L th  P°sslble  contingencies  and 
"logical  " rather  than  technical  ^ 7 Pr°blema  dn  CITS  simulation  are 

component  be  augmented  bv  suitahip  i recominended  that  procurement  of  this 
functions  are  determined  0317368  t0  be  C3rrled  0ut  before  the  malf 

(IKB)  involvl^alphanumeric  dUpJ”2  Sr'cRT-afaud  f ^ inteeMted  J^i-Oard 
aspect  of  the  simulation  of  this  component  it!  controls.  An  importan 

easily  updated  so  that  the  simulation  am  - ensure  that  the  simulation  is 
of  the  software  program  £ thl  air  vehicu!  y rePraSantS  tha  la“a‘  “Plates 

system  (FLIR)?  ^fprjviouslj  discussld°”simulatl  ^ tb%f?r"ard“IooklnB  infrared 
interactive  mode  is  a problem  within  thl  simulati°n  of  FLIR  in  a real-time, 

Due  to  the  fact  that  most  FLIR  training  ca^n*1*  SJmulation  state-of-the-art . 

(e.g.,  FLIR  interpretation  and  targeJ  detection)*  non7lnteractive  mode 
appears  to  be  unnecessary.  Interactive  FLIR  train!  » faCtive  simulation  of  FLIR 
training  instructional  blocks.  This  should  not  . ng  s accomplished  in  airborne 
framing  is  short  in  durations not **"  8lnCa  tba 
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rn.  training  objective  for  the  0S0  illustrated  the  requirement  for 

to  Si  nS  ™°r  Dev1ice43/°S0‘  That  is  b°dily  motion  is  not  an  important  cue 
o the  0S0.  This  result  is  in  concurrence  with  the  experience  gained  by  other 
ystems  operators  training  programs  (e.g.,  S-3A).  The  only  aspect  of  motion 

I^the  ^ M 2 the  disruptive  (task-loading)  effects  (e.g.,  buffeting). 
In  the  situations  where  task-loading  is  a contributer  to  training  effectiveness, 

can  be  accomplished  at  much  less  expense  (procurement  and  O&M)  by  other  means 
(e.g.,  malfunction  insertion).  means 

The  instructional  features  required  within  Device  3/0S0  are 
essentially  the  same  as  those  included  in  Device  3/P/CP  (see  previous  sub- 
section). Similarly,  the  instructor/operator  stations  are  similar. 


„ i , is  possible,  with  this  configuration , to  utilize  an  instructor 
console  within  the  trainer  cockpit.  This  allows  rapid  instructor  feedback  to  the 

tr^in!!»and  ®ubsaq“enb  real-time  training  sortie  modification  on  the  basis  of  the 
trainee  s motor  behavior.  A format  that  is  effective  in  instructor-simulator- 

*ntaractlona  is  a combination  of  graphical  representation  of  actual  and 
esired  trainee  performance  (e.g,,  lower  third  of  the  display)  and  an  alpha- 

sortieCs^on2ffi04  f°\data  entry  and  access  event  occurences,  mission 

1 syn°psl®)‘  A logic-tree  organization  for  data  entry  and  access  is 

commended  The  insertion  of  data  and  requests  utilizes  two  special  function 

h'fj6rke,rr40xe4f"Ti  PUrPH  keyb0“d-  °“  °f  the  special  function  keyboards 
^ ®nd  1®  USfd  f°r  m°St  frecluently  used  malfunction  insertions 
SDer^?1?8  pr°Sramned  realistic  combinations  of  malfunctions).  The  second 

the  lni/T  ^ey?°a^  nlne  keyS  (9  X 1}  and  ±s  used  to  access  data  through 
kevbiardCthItei  PlT  °n  th<T  CRT-  The  third  *nPut  device  is  a general  purpose 
This  ^ ^ lnSertl0n  and  access  of  less  Hkely  malfunctions. 

This  arrangement  allows  a great  amount  of  versatility  in  the  system  while  ensuring 
rapid  interaction  between  the  instructor,  simulator,  and  trainee.  8 

i A si®ilar  configuration  is  recommended  for  an  instructor/operator 

aMn2  o/n/in  cockpit-  Thls  a°nsole  should  be  capable  of  oper- 

T V cockpits.  The  configuration  involving  the  instructor 

being  at  an  external  console  is  particularly  useful  during  later  taining  (ad- 
vanced practice)  when  the  trainee's  demands  on  the  instructor's  vigilance  is 
Y ,r®d’f  ed‘  Aa  ona  additional  feature  of  Device  3,  the  facilities 
P an  (Section  4)  is  allowing  for  direct  entrance  of  the  trainees  to  their  work 
tation  without  walking  past  the  computer  or  instructur's  consoles.  By  so  doing, 

Wr  ^ t0c  redUCe  the  artifidallity  of  the  setting,  so  as  to 

increase  the  involvement  of  the  trainees  in  their  training  environment. 

3. 3.4. 3 Device  3/DSO  Part-Mission  Trainer 

n c 4 .ThlS  de^ice  is  an  electronic  warfare  simulation  used  for  training  the 
efensive  Systems  Operator  <DSO)  on  real-time  ECM  tasks.  The  primary  components 
of  this  device  are  various  data  input  (and  acquisition)  keyboards,  panoramic 
(frequency  spectrum)  display,  threat  situation  display,  alphanumeric  display, 
and  a cursor  control.  As  with  Device  2/DSO,  a detailed  description  of  this 
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device  is  dependent  upon  the  conduction  of  an  analysis  of  the  DSO  tasks. 

As  was  discussed  in  the  Simulation  Technlogy  Assessment  Report,  this  trainer 
is  expected  to  be  within  the  present  state-of-the-art  in  simulation.  The 
instructor  stations  and  automatic  performance  measurement  and  pre-programming 
capabilities  are  anticipated  to  be  functionally  similar  to  the  3/0S0  trainer. 

3. 3. 4. 4.  On-board  Computer 

The  B-l  air  vehicle  contains  a number  of  on-board  computers  much 
of  whose  capabilities  must  be  included  in  Device  3.  In  the  course  of  this 

study,  an  examination  was  made  of  the  various  means  for  providing  this  capability. 
These  include: 


1.  Duplication  of  airborne  equipment; 

2.  Evaluation  - incorporation  of  the  Operational  Flight  Program 
(OFP ) as  a subroutine  of  the  various  training  devices 
computers  with  interfacing  models  to  provide  the  instruc- 
tional requirements; 

3.  Simulation  of  airborne  equipment. 

The  choice  among  them  depends  upon  trade-off  decisions  related  to  the  allocation 
of  functions  within  the  OFP  and  the  impact  on  the  training  devices  of  revisions 
to  the  OFP.  Recommendations  cannot  be  made  at  this  time,  but  a more  complete 
assessment  of  the  problem  is  the  subject  of  B-l  SAT  Management  Memo  MMSAT-20 
(Software  Support  of  Trainees;  WFHRing;  6 June  1925). 

3.3.5  Device  4 - Full  Mission  Trainer 


This  device  is  a total-crew  trainer  that  provides  crew  coordinated 
practice  of  the  mission.  The  0S0  and  DSO  stations  of  this  device  are  the  same 
as  Device  3/0S0  and  3/DSO,  with  the  addition  of  an  interface  between  the  trainers 
to  provide  interaction  capabilities. 

The  front  station  (pilot  and  copilot)  of  this  device  is  similar  to 
the  Device  3/P/CP,  with  the  addition  of  the  same  systems  not  included  in  the 
previously  described  device  (e.g.,  weapons  (e.g.,  weapons  systems)  and  the  inter- 
face with  the  0S0  and  DSO  stations. 

This  device  can  be  utilized  in  both  an  integtated-crew  mode  or  a 
crew  member-independent  mode  (e.g.,  0S0  and  DSO,  practicing  interactively  with 
the  front  station  being  totally  Independent).  The  instructors'  station  in- 
corporates up  to  three  instructors  (0S0,  DSO  and  Pilot)  that  work  either  in  a 
coordinated  manner  (crew  interacting)  or  independently  (crew  not  interacting). 


As  with  the  Device  3s,  this  trainer  incorporates  automatic  performance 
measurement,  performance  record  and  playback,  and  pre-programmed  mission 
capabilities.  The  purpose  of  this  device  is  for  the  practice  and  evaluation 
of  the  entire  crew  on  an  emergency  war  order  (EWO)  mission. 
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3.4  PREFERRED  INSTRUCTIONAL  SYSTEM  DESIGN 

The  first  two  steps  in  the  process  of  SAT  (analysis  of  the  opera- 
tional mission  and  identification  of  behavioral  objectives)  are  means  to  the 
end  product.  The  end  product  is  an  effective  training  system  of  least  cost 
One  aspect  of  this  training  program  is  the  devices  and  facilities  required. 
The  devices  were  introduced  in  the  preceding  paragraphs,  while  the  facility 
requirements  are  described  in  the  next  section.  A second  aspect  of  the  pro- 
gram is  the  sequence  of  instructional  blocks  that  make  up  the  course  syllabi. 
This  sequencing  of  blocks  is  based  on  both  learning  principles  and  effective 
resource  (device)  utilization. 

3.4.1  Instructional  Strategy 

The  guidelines  provided  within  the  principles  of  learning  that 
generally  pertain  across  the  spectrum  of  training  objectives  are  the  basis 
or  organizing  instructional  block  sequences.  One  of  these  guidelines  that 
as  previously  been  introduced  in  the  preceding  section  is  active  participa- 
tion by  the  trainee.  This  "early  hands-on"  philosophy  results  in  both  su- 
perior training  effectiveness,  as  well  as  increased  trainee  attention  and 
motivation  (which  is  obviously  correlated  with  training  effectiveness).  The 
implementation  of  this  guideline  illustrates  the  interactiveness  of  training 
objectives,  training  device  requirements,  and  instructional  block  sequencing. 
Io  incorporate  hands-on  training,  while  ensuring  that  device  capability  is 
not  under-utilized  during  the  various  stages  of  training,  a spectrum  of 
devices  is  required  as  described  in  the  previous  section.  That  is,  the  fi- 
delity required  during  early  training  is  often  less  than  that  required  for 
later  training,  and  the  use  of  a complex  device  in  the  former  case  is  not 
cost-effective. 

A second  principle  that  is  well-established  in  the  literature  of 
learning  theory  is  that  acquisition  of  new  information  is  facilitated  when 
new  information  is  associated  with  previously-learned  concepts.  The 
general  result  of  adhering  to  this  principle  is  that  a context  is  provided 
within  which  the  new  information  becomes  more  meaningful.  A term  used  within 
the  SAT  methodology  which  is  associated  with  this  principle  is  the  enabling 
objectives  hierarchy  discussed  in  Section  2. 1.7. 3.  Again,  this  principle  has 
implication  with  respect  to  device  utilization.  Prerequisite  (enabling) 
skills  and  knowledges  are  usually  acquired  individually  in  simple  devices  and 
are  later  integrated  into  the  more  complex  skill  in  a more  complex  device. 

In  the  context  of  aircrew  training,  this  often  takes  the  form  of  increased 
difficulty  due  to  task  loading. 


Another  guideline  that  results  in  increased  trainee  motivation  and, 
thereby  increased  training  effectiveness,  is  spaced  practice  (as  opposed  to 
massed  practice).  This  guideline  pertains  to  both  material  and  devices. 

That  is,  trainee  boredom  can  result  from  a long  exposure  to  the  same  material 
or  a long  period  of  time  in  the  same  device. 
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Three  operational  characteristics  of  training  objectives  also  play 
a part  in  the  determination  of  instructional  block  duration  and  sequencing. 
These  factors  are:  (1)  difficulty,  (2)  criticality,  and  (3)  probability  of 

occurrence.  There  are  two  aspects  of  objective  difficulty:  difficulty  to 

perform  the  behavior  and  difficulty  to  learn  the  behavior.  These  two  are 
often  correlated,  although  they  are  often  quite  independent.  Both  of  these 
aspects  of  difficulty  must  be  taken  into  account  in  developing  course  content. 

The  four  crewmembers  of  the  B-l  air  vehicle  are  components  of  the 
entire  B-l  weapons  system.  As  with  any  component  of  a weapons  system,  the 
crewmember  has  associated  with  him  a "reliability".  The  purpose  of  a training 
program  is  to  increase  the  reliability  of  the  crewmember  component.  This  in- 
crease in  reliability  can  be  costly,  2nd  —lst  be  evaluated  ( as  with  other 
components)  as  to  whether  the  increase  warrants  the  cost.  It  is  during  this 
evaluation  that  the  difficulty,  criticality,  and  probability  factors  are  im- 
portant. For  e.ample,  the  criticality  of  a training  objective  influences  the 
training  time  in  that  if  an  objective  (e.g.,  engine  failure  emergency  proce- 
dure) has  high  criticality  with  respect  to  accomplishing  the  mission,  training 
time  must  be  sufficient  to  ensure  that  the  trainee  can  accomplish  the  mission. 
On  the  other  hand,  if  the  objective  is  not  critical  (no  impairing  effect  on 
the  mission) .then  less  training  time  is  justified. 


As  in  the  evaluation  of  any  component's  reliability,  the  probability 
of  an  event  occurring  is  important  in  deciding  whether  additional  expense  is 
justified  to  increase  the  probability  of  handling  that  event.  Training  of 
aircrew  members  is  no  different.  If  the  probability  of  the  event  is  "high", 
the  behavior  required  to  handle  the  event  must  be  trained  and  the  time  alloca- 
ted for  training  that  behavior  must  be  sufficient.  It  is  obvious  that  the 
criteria  for  when  the  probability  and  criticality  are  "high"  is  ill-defined. 
The  cooperative  judgment  of  operational  personnel  and  training  specialists 
must  be  used  to  make  decisions  of  this  type.  One  of  the  often-cited  purposes 
of  including  a human  in  a system,  as  opposed  to  total  automation,  is  the 
human's  ability  to  adapt  and  handle  situations  (events)  that  have  not  been 
previously  encountered.  A training  program  that  attempts  to  exhaustively 
train  on  all  possible  (low  probability)  situations  is  disregarding  the  crew- 
members' inherent  capabilities. 

^•4.2  Airborne  and  Ground  Training  Limitations 

There  are  a number  of  situations  that  cannot  be  encountered  during 
training  in  the  air  vehicle  but  can  be  simulated  in  training  devices.  The 
most  recognized  areas  in  which  the  air  vehicle  is  limited,  relative  to  simu- 
lation, is  in  emergency  situations  that  are  potentially  hazardous  to  the  air 
vehicle  as  well  as  the  crew  (e.g.,  engine  failure  on  take-off).  These 
situations  can  be  simulated  in  the  training  devices  while  monitoring  safety 
requirements. 
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annm^w  / sacond»  aad  related,  area  in  which  simulation  is  the  only  feasible 
h .is .the  training  for  equipment  malfunctions  that  may  jeopardize  the 

vf  imu°laHoenCr?t^  thiS  iS  a SOmewhat  lesS  odious  aspect  of  flight 

vs.  simulation,  it  ^s  an  important  concern.  s 

SB1?— 

for  training.  This  limitftiiThas bef?evl  uateHS the°B Tsa^16 

n»it«ireC°rrtl0nS  are  with  the  preset  (1975)  Ii?  sp™ 

limitations  (Military  Training  Routes,  11  Sept.,  1975).  ? 

training  flights  is  a^eal istic1^^^ S (EKol  1 ^ cannot  be  achieved  in 
tronic  warfare  trainina  1 ! • J CEK0)  t>nvironment.  The  case  of  elec- 

perior  to fTight we^iETtf^16  ?Vhis-  Simulati°"  is  far  su 
scenarios.  sLilaSy Is Til.LV/  * ^ *ealistic  ECM  (threat) 
can  be  manipulated  to’resulc  in  effeitive^Solrl  S- Ctl°n’  Simulated  landmass 
maSS  ah“istics  that  is  difficult  to 

in-flight  is  the1advantagefofrthe1in-tni?t°UndibfSed  devlces  rather  than 
ability  to  "freeze"  the  fllEht^,  5l<*al  features-  For  example,  the 

utility.  Similarly,  the  performance  iecord^16^  ^ instruction  has  great 
effective  for  trainee  feedback  recordlag  and  on-line  playback  is  very 

to  ground  airb°™  aa  °PP°-d 

devices  (e.g. , Device  3),  these  devices  must  be  ope rational for  instructor 
training  two  months  prior  to  the  first  trainee  entry  date.  This  lead  time 
for  instructor  training  on  the  devices  Is  very  Important  for  effective 
utilization  of  the  device  capabilities. 

of  the  syntheti^trainin^capabilities  0?^^  "eXt’  JfaV?  made  maximum  use 
earlier).  The  essential  training  CCct-f,  ^raining  devices  (described 
least  costly  device  possible  with  nr  nC'1S  and  knowledges  takes  place  in  the 

ticated  devices.  In  the  course  structures*  tST^if6  ^ ^ ^ SOphis_ 
"ultimate"  practice  device  The  /,  B_1  used  Primarily  as  the 

marily  in  the iTare  Z^  ^ iS  aCqUired  pri" 

the  FLIR  System  (see  Section  3.3.4)?  real-time,  interactive  aspects  of 

3,4,3  Basic  Structure  of  the  Courses 


3.4.3. 1 


Combat  Crew  Training  School  (CCTS)  Instructional  Block  Sequence 


today  th-^S’vSiSSJ'iTtS'Jj?  thTheB';raire  °P"at‘>-" 

change.  The  basic  structure  of  ' . tralning  programs  reflect  this 

"systems  within "of-nUt"  t^T  * Pr0gra”  is  °"e  °f 

latter  group  of  systems,  l^liie^S^o 
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The  concept  of  systems  within  phase-of-f light  is  consistent  with  the  previous-, 
ly  mentioned  learning  guidelines  (e.g.,  building  associations  on  the  basis  of 
context). 

There  are  four  courses  included  at  the  CCTS  (pilot,  copilot,  0S0, 
and  DSO) . Within  each  of  these  courses,  there  are  "tracks"  that  result  from 
differing  trainee  entry  level  abilities  which  derive  from  their  source  of 
training  and  experience  prior  to  B-l  assignment.  There  are  a total  of  ten 
tracks  at  the  CCTS  within  the  four  courses  (Table  3.).  Sources  are  not 
exclusively  those  shown.  These  tracks  will  accept  any  trainee  of  comparable 
experience. 


Table  3 

Definition  of  Tracks 

Course 

Track 

Source  (typical) 

Pilot 

A 

FB-111  pilot 

B 

B-52  pilot 

C 

KC-135  pilot 

Copilot 

D 

B-52  copilot 

E 

Undergraduate  Pilot  Training  (UPT) 

OSO 

F 

FB-111  Navigator 

G 

B-52  Navigator/bombadier 

H 

Undergraduate  Navigator  Training  (UNT) 

DSO 

I 

B-52  Electronic  Warfare  Officer 

J 

Electronic  Warfare  Officer  Training  (EWOT) 

The  sequencing  of  the  instructional  blocks  which  make  up  the  syllabi  for  the 
Preferred  Instructional  System  (excluding  the  DSO)  is  presented  in  Figure  11  . 
This  example  shows  a series  of  three  instructional  blocks  for  Track  1 and  two 
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COURSE  A 


TRACK  1 

j TITLE  A 

TITLE  B 

TITLE  C 

1 | 2 

1 3 

3 | 4 

51 

52 

TITLE  A 

TITLE  C 

TRACK  2: 

1 1 2 

~ 1 2 

Figure  1 1 SAMPLE  INSTRUCTIONAL  BLOCK  SEQUENCE 
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blocks  for  Track  2.  On  top  of  each  block  is  its  designating  number.  Within 
the  block  are  written  the  block  title,  training  device  (lower  left),  and 
time  in  hours  (lower  right).  The  training  device  is  the  one  appropriate  to 
the  track  (e.g..  Device  3 for  a copilot  track  refers  to  Device  3/P/CP).  The 
first  two  blocks  of  bcth  tracks  are  identical.  The  Track  2 individuals  do 
not  go  through  the  second  block  of  Track  1.  The  last  block  involves  the 
same  subject  matter,  but  Track  2 needs  less  time  due  to  an  increased  level 
of  incoming  knowledge.  Blocks  that  involve  the  same  subject  matter  are  lined 
up  vertically  across  pilot  and  copilot  tracks  and  across  0S0  tracks. 

For  convenience  in  preparing  this  chart,  the  instructional  blocks 
within  each  track  were  numbered  sequentially  and  independently  of  the  other 
tracks.  Consequently,  blocks  in  different  tracks,  but  having  the  same  block 
number,  usually  do  not  have  related  content. 

An  instructional  strategy  was  employed  with  regard  to  crew  coordi- 
nation in  which  some  blocks  are  "correlated"  and  some  are  "synchronized." 
Correlation  occurs  between  pilot  and  copilot  blocks  when  the  content  of 
analogous  blocks  requires  coordinated  participation  of  both  crew  members. 

In  earlier  stages  of  trainings  the  particular  pairing  of  a pilot/copilot  team 
is  irrelevant.  In  these  cases,  each  is  paired  with  any  (or  the  next)  available 
partner.  This  scheme  allows  one  instructor  to  supervise  two  trainees  rather 
than  to  use  the  instructor  as  a surrogate  crew  member  while  supervising  only 
one  trainee.  In  later  stages  of  training,  the  coordinated  practice  of  a 
particular  entire  crew  becomes  important  to  lessen  the  effects  of  idiosyn- 
cracies  that  can  disrupt  the  smoothness  of  a chew's  operations  when  one  or 
more  "strangers"  are  put  together.  To  achieve  crew  coordination,  the  last 
blocks  for  all  tracks  are  synchronized.  That  is,  for  a period  of  time  before 
graduation,  a crew  is  formulated  that  then  stays  together  during  the  end  of 
their  CCTS  training  and  who  are  then  assigned  as  a crew  to  a Main  Operating 
Base  (MOB).  Correlations  are  indicated  in  Figure  12  by  a C in  the  dividing 
space  between  the  Pilot  and  Copilot  tracks  (no  correlations  exist  with  CSO 
and  DSO  tracks).  With  two  exceptions,  all  synchronized  blocks  are  merged  in- 
to one  track  at  the  appropriate  point  (last  two  pages  of  the  chart).  Again, 
for  convenience, this  final  synchronization  track  is  consecutively  numbered 
independently  of  the  other  tracks.  In  two  cases,  before  the  trainees  reach 
the  Synchronization  Phase,  synchronized  blocks  occur  in  which  the  crew  (the 
same  members  to  be  matched  up  later)  comes  together  for  coordinated  training 
for  the  first  and  second  time  • The  blocks  of  the  first  instance  are  desig- 
nated by  a single  asterisk  next  to  the  instructional  block  number;  the  second 
is  marked  by  a double  asterisk  on  the  particular  block  in  each  track.  These 
blocks  are  among  those  in  which  Devices  2/P/PC,  2/0S0,  and  2/DSO  are  linked 
by  communications  so  that  coordinated  practice  can  take  place. 

It  should  be  noted,  as  discussed  at  various  points  in  this  report, 
that  the  actual  sequencing  depends  on  a number  of  factors,  including  learning 
strategy.  In  the  process  of  refining  the  courses,  the  ISD  team  will  have  the 
prerogative  of  interchanging  blocks  and  altering  their  content  to  achieve 
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more  efficient  learning  and/or  scheduling  of  students  and  resources.  fin 
fact,  the  placement  of  some  of  the  instructional  blocks  requiring  early 
synchronization  was  done  on  this  basis  of  scheduling  to  avoid  introducing 
waiting  periods  prior  to  the  crew  rejoining  at  the  ends  of  their  courses.) 

An  important  consideration  in  the  use  of  the  various  training  de- 
vices to  satisfy  behavioral  objectives  is  the  symmetry  of  the  B-l  front 
station  instrumentation.  That  is,  relationship  of  the  controls  and  displays 
for  both  the  pilot  and  the  copilot  are  in  essence,  identical  (e.g.,  throttle 
levers).  Therefore,  it  is  possible  to  practice  most  pilot  and  copilot  tasks 
in  either  the  left  or  right  seat  of  Devices  2,3,  and  4.  This  capability 
results  in  greater  versatility  in  scheduling  (e.g.,  pairing  of  pilots  or  of 
copilots  for  Device  2,3,  and  4 sessions). 

Table  4 summarizes  the  major  features  of  the  CCTS  courses  relevant 
to  device  utilization  and  total  nominal  contact  hours  per  track.  In  addition 
to  Devices  0,1, 2, 3,  and  4,  the  table  also  lists  hours  in  briefing  rooms,  in 
airborne  training,  and  ground  use  of  B-l  air  vehicles. 

Closely  associated  with  the  Instructional  Block  chart  (Figure  12) 
is  the  listing  (Table  18)  of  those  instructional  blocks  within  which  the 
criteria  of  each  Behavioral  Objective  is  first  attained.  Table  18  is  in- 
cluded as  Section  6 of  this  volume.  For  each  Behavioral  Objective  (cf. 
Technical  Memorandum  SAT-2) , the  instructional  block  is  listed  (for  each 
track)  which  satisfies  the  requirements  of  that  objective.  Later  blocks, 
of  course,  may  re-evaluate  that  objective  in  conjunction  with  other  objectives. 
Earlier  blocks  provide  the  enabling  skills  and  knowledges  required  to  later 
achieve  the  Behavioral  Objectives.  The  Instructional  Block  chart  (Figure  12) 
follows . 
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Table  4 

CCTS  SUMMARY  TABLE  OF  COURSE  DURATIONS  (HOURS) 
BY  TRAINING  DEVICE 


COURSE 

PILOT 

CO-PILOT 

OSO 

DSO2 

TRACK1 

A 

B 

C 

D 

E 

F 

G 

H 

1 

J 

DEVICE 

BRIEFING 

89 

96 

108 

96 

96 

76 

81 

89 

97 

107 

0-  CARREL 

43 

40 

68 

40 

68 

78 

84 

110 

50 

60 

1 - FAMILIARIZATION 

31 

43 

48 

43 

48 

2 -PROCEDURES 

363 

403 

403 

403 

403 

81 

84 

86 

40 

50 

3 - PART-MISSION 

29 

37 

48 

37 

37 

24 

35 

50 

50 

65 

4 - FULL-MISSION 

21 

21 

21 

21 

21 

21 

21 

21 

21 

21 

B1 

27 

27 

33 

27 

27 

21 

21 

21 

21 

21 

TOTAL 

276 

304 

366 

304 

337 

301 

326 

377 

279 

324 

Typical  source  of  trainees 


Preliminary  estimates  only 
Includes  2 hours  in  device  2/oso 


FIGURE  12 


INSTRUCTIONAL  BLOCKS 
(Pages  54  - 79) 


ABBREVIATIONS  FOR  FIGURE  12 


A/C 

Aircraft 

ACU 

Avionics  Control  Unit 

AFCS 

Automatic  Flight  Control  System 

Alt  Proc 

Alternative  Procedures 

APU 

Auxiliary  Power  Unit 

AR 

Aerial  Refueling 

ATF 

Automatic  Terrain  Folliwing 

Aux  Nav 

Auxiliary  Navigation 

CITS 

Central  Integrated  Test  System 

c.g. 

Center  of  Gravity 

conv 

Conventional 

DR 

Dead  Reckoning 

ECM 

Electronic  Countermeasures 

EVS 

Electro-Optical  Viewing  System 

FLIR 

Forward  Looking  Infra-Red 

FLR 

Forward  Looking  Radar 

ICS 

Intercom  System 

IKB 

Integrated  Keyboard 

INS 

Inertial  Navigation  System 

IP 

Initial  Point 

jett 

Jettison 

Ldg 

Landing 

MTF 

Manual  Terrain  Following 

Nav 

Navigation 

Nuc 

Nuclear 

PIP 

Pre-Initial  Point 

SCAS 

Stability  and  Control  Augmentation  Syst 

SMCS 

Structural  Mode  Control  System 

SMS 

Stores  Management  System 

TF 

Terrain  Following 

TFR 

Terrain  Following  Radar 

TO 

Take-Off 

V3D 

Vertical  Situation  Display 

X-Hair 

Cross  Hair 

I 

I 


I 


5 

6 

7 

8 

9 

DEBRIEFING 

A/C  FLIGHT 
CHARACTERISTICS 

FLIGHT  AND 
ENGINE  INSTRUMENTS 

VSO  ORIENTATION 
& SYMBOLOGY 

PRIMARY  FLIGHT 
CONTROLS  (SCAS, 
SMCS) 

DEV  S ] 1 HR 

OEV  0 | 2 HR 

DEVI  | 2 HR 

OEV  0 1 2 HR 

OEV  1 | ThR 

s 

6 

7 

8 

9 

DE8RieM*G 

A/C  FLIGHT 
CHARACTERISTICS 

FLIGHT  ANO 
ENGINE  INSTRUMENTS 

VSD  ORIENTATION 
& SYMBOLOGY 

PRIMARY  FLIGHT 
CONTROLS  (SCAS. 
SMCS) 

0€  V B f 1 HR 

OEV  O | 2 HR 

OEV  1 | 6 HR 

DEVO  1 2 HR 

DEV  1 | 6 HR 

5 

6 

7 

8 

9 

OEBRIEFING 

A/C  FLIGHT 
CHARACTERISTICS 

FLIGHT  ANO 
ENGINE  INSTRUMENTS 

VSD  ORIENTATION 
& SYMBOLOGY 

PRIMARY  FLIGHT 
CONTROLS  (SCAS. 
SMCS) 

DEV  B f T HR 

DEV  0 | 2 HR 

DEV  1 | 6 HR 

OEVO  1 2 HR 

DEVI  | 6 HR 

v. 

s 

6 

7 

8 

9 

DEBRIEFING 

A/C  FLIGHT 
CHARACTERISTICS 

FLIGHT  AND 
ENGINE  INSTRUMENTS 

VSD  ORIENTATION 
& SYMBOLOGY 

PRIMARY  FLIGHT 
CONTROLS  (SCAS. 
SMCS) 

| DEV  8 I 1 HR 

OEV  0 | 2 HR 

DEV  1 | 6 HH 

DEVO  1 2 HR 

DEVI  1 6 HR 

5 

6 

7 

8 

9 

DEBRIEFING 

A/C  FLIGHT 
CHARACTERISTICS 

FLIGHT  AND 
ENGINE  INSTRUMENTS 

VSD  ORIENTATION 
& SYMBOLOGY 

PRIMARY  FLIGHT 
CONTROLS  (SCAS. 
SMCS) 

DEV  B | 1 HR 

- , 

DEV  0 | 2 HR 

DEVI  ] 6 HR 

DEV  0 1 2 HR 

OEV  1 | 6 HR 

.WV.V.V.V/rfV.V.’. 

4 

5 

6 

FLR  X HAIR 
CONTROL  SWITCHES 

FLR  X HAIR 
CONTROL  & 
TRACKING 

FLR  X HAIR 
CONTROL  & 
TRACKING 

DEV  0 j 1HR 

OEV  2 | 2 HR 

DEV  3 | 2 HR 

4 

5 

6 

7 

8 

FLR  X-HAIR 
CONTROL  SWITCHES 

FLR  X HAIR 
CONTROL  & 
TRACKING 

FLR  X HAIR 
CONTROL  & 
TRACKING 

FLR 

ORIENTATION 

FLR 

TUNE  UP 

DEV  0 | 1 HR 

DEV  2 | 2 HR 

OEV  3 | 2 HR 

OEV  0 1 2 HR 

DEV  O [ 1 HR 

4 

5 

6 

7 

8 

FLR  X HAIR 
CONTROL  SWITCHES 

FLR  X-HAIR 
CONTROL  & 
TRACKING 

FLR  X HAIR 
CONTROL  & 
TRACKING 

FLR 

ORIENTATION 

FLR 

TUNE  UP 

OEV  0 | 1 HR 

OEV  2 | 2 HR 

DEV  3 | 2 HR 

DEV  0 | 2 HR 

DEV  0 | 2 HR 
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r 


SECONOARY 
FLIGHT  CONTROLS 


OEV  1 2 HR 


COMMUNICATION/ 

NAVIGATION 


DEV  1 2 HR 


12 


PERFORMANCE/ 
MISSION  PLANNING 
{TO,  LOG) 


~OEV  0 | 1~HR~ 


13 


BRIEFING/ 

OEBRIEFING 


OEV  B 1 HR 


14 


TO.  LOG. 
PRACTICE 


OEV  3 2 HR 


SECONDARY 
FLIGHT  CONTROLS 


OEV  1 ]~ 


3 HR 


COMMUNICATION/ 

NAVIGATION 


OEV  1 2 HR 


12 


PERFORMANCE/ 
MISSION  PLANNING 
(TO.  LDGI 


DEV  0 1 HR 


BRIEFING/ 

OEBRIEFING 


DEVB  1 HR 


14 


TO.  LDG. 
PRACTICE 


OEV  3 2 HR 


10 

SECONOARY  1 
FLIGHT  CONTROLS 


COMMUNICATION/ 

NAVIGATION 


12 


performance/ 

MISSION  PLANNING 
(TO.  LDGI 


BRIEFING/ 

OEBRIEFING 


14 


TO.  LOG. 
PRACTICE 


SECONDARY 
FLIGHT  CONTROLS 


COMMUNICATION/ 

NAVIGATION 


PERFORMANCE/ 
MISSION  PLANNING 
(TO,  LOG) 


SECONOARY 
FLIGHT  CONTROLS 


COMMUNICATION/ 

NAVIGATION 


PERFORMANCE/ 
MISSION  PLANNING 
(TO,  LDGI 
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HYDRAULIC 

SYSTEM 


16_ 

LANDING  GEAR 
& BRAKES 


PRIMARY  FLIGHT 
CDNTRDLS  (ALT 
PROC..  SCAS 
FAILURES) 


PRIMARY  FLIGHT 
CONTROLS  (ALT. 
PROC  SCAS 
FAILURES) 


SECONDARY  FLIGHT 
CONTROLS  (ALT. 
PROC.) 


1 HR 

DEVI 

1 HR 

KaXBIHlIIH 

i 

DEV  1 

HYDRAULIC 

SYSTEM 

LANDING  GEAR 
& BRAKES 

PRIMARY  FLIGHT 
CONTROLS  (ALT. 
PRDC., SCAS 
FAILURES) 

PRIMARY  FLIGHT 
CONTROLS  (ALT, 
PROC.,  SCAS 
FAILURES) 

SECONDARY  FLIGHT 
CONTROLS  (ALT. 
PRDC.) 

DEV  1 7 1 HR 

DEV  1 | 1 HR 

DEV  1 | 2 HR 

DEV  2 | 2 HR 

DEV  1 | 1 HR 

mm 


ICS  & 

•-  LIGHTING 


PERFORMANCE/ 
MISSION  PLANNING 


PRESENT  PDSITIDN. 
SELECTED  POINT 
STEER  (NAV 
PANEL) 


PRESENT  POSITION. 
SELECTED  POINT, 
STEER  (NAV 
PANEL) 


DEV  0 1 HR 


ICS  & 
LIGHTING 


DEV  0 1 HR 


PERFORMANCE/ 
MISSION  PLANNING 


DEV  0 2 HR 


PRESENT  POSITION. 
SELECTED  POINT. 
STEER  (NAV 
PANEL) 


DEV  2 2 HR 


ICS  & 
LIGHTING 


PERFORMANCE/ 
MISSION  PLANNING 


PRESENT  POSITION 
SELECTED  PDINT. 
STEER  (NAV 
PANEL) 


PRESENT  POSITION. 
SELECTED  PDINT 
STEER  (NAV. 
PANEL) 


PRESENT  POSITION. 
SELECTEO  POINT. 
STEER (NAV 
PANEL) 


1 

^ -SB?- 
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SECONDARY  FLIGHT 
CONTROLS  (ALT 
PROC.) 


21 

BRIEFING/ 

DEBRIEFING 


22 

TO,  LDG., 
FLIGHT  CONTROL 
EMERGENCIES 


I 

I 

I 

I 

I 

I 

I 


1; 

0 


i: 


i 

i 

i 


23 

24 

25 

26 

27 

FIRE  WARNING 
SYSTEM 

ENGINE  START 
APU 

TO.  LDG. 
EMERGENCIES 

BRIEFING/ 

DEBRIEFING 

TO,  LDG. 
(EMERGENCIES) 

DEV  2 1 1 HR 

DEV  2 1 1 HR 

DEV  2 | 2 HR 

DEV  B | 1 HR 

DEV  3 | 2 HR 

25 

26 

27 

28 

29 

FIRE  WARNING 
SYSTEM 

ENGINE  START 
APU 

TO.  LDG. 
EMERGENCIES 

BRIEFING/ 

DEBRIEFING 

TO.  LDG. 
(EMERGENCIES/ 

DEV  2 I 1 HR 

DEV  2 T 1 HR 

DEV  2 | 2 HR 

DEV  B | 1 HR 

DEV  3 | 2 HR 

25 

26 

27 

28 

29 

FIRE  WARNING 
SYSTEM 

ENGINE  START 
APU 

TO.  LDG 
EMERGENCIES 

BRIEFING/ 

OEBRIEFING 

TO,  LDG. 
(EMERGENCIES) 

| DEV  2 | 1 HR 

DEV  2 I 1 HR 

DEV  2 | 2 HR 

DEV  B ~|  1 HR 

DEV  3 | 2 HR 

(C)’ 

25 

26 

27 

28 

29 

FIRE  WARNING 
SYSTEM 

ENGINE  START 
APU 

TO.  LDG 
EMERGENCIES 

BRIEFING/ 

DEBRIEFING 

TO,  LDG 
(EMERGENCIES) 

DEV  2 1 1 HR 

DEV  2 ] 1 HR 

DEV  2 | 2 HR 

DEV  B J 1 HR 

DEV  3 | 2 HR 

25 

26 

27 

28 

29 

FIRE  WARNING 
SYSTEM 

ENGINE  START 
APU 

TO.  LDG 
EMERGENCIES 

BRIEFING/ 

DEBRIEFING 

TO.  LDG. 
(EMERGENCIES) 

DEV  2 X 1 HR 

DEV  2 | 1 HR 

DEV  2 | 2 HR 

DEV  B ] 1 HR 

DEV  3 | 2 HR 

y/. 

V.'.V.V.V.W.W.V  v.v.v 

• *.  y K r r . * 

16 

17 

18 

19 

20 

INS,  DOPPLER 
DR 

PRESENT  POSITION 
CORRECTION 

PRESENT  POSITION 
CORRECTION 

BRIEFING/ 

DEBRIEFING 

NAVIGATION 

PRACTICE 

DEV  2 1 2 HR 

DEV  0 | 1HR 

DEV  2 | 1 HR 

DEV  B | 1 HR 

DEV  3 | 2 HR 

24 

25 

26 

27 

28 

INS.  DOPPLER 
DR 

PRESENT  POSITION 
CORRECTION 

PRESENT  POSITION 
CORRECTION 

BRIEFING/ 

OEBRIEFING 

NAVIGATION 

PRACTICE 

DEV  2 1 2 HR 

DEV  0 | 2 HR 

DEV  2 | 2 HR 

DEV  B | 1 HR 

DEV  3 | 2 HR 

24 

25 

26 

27 

28 

INS,  DOPPLER 
DR 

PRESENT  POSITION 
CORRECTION 

PRESENT  POSITION 
CORRECTION 

BRIEFING/ 

DEBRIEFING 

NAVIGATION 

PRACTICE 

DEV  2 1 2 HR 

OEV  0 | 2 HR 

DEV  2 | 2 HR 

DEV  B [ 1 HR 

DEV  3 | 2 HR 

59 


66  _ 
DEBRIEFING 


69 


70 


,JL.  ..  . 


A:->yx«:v.v:v:»:»xv.- ••••.•••••• 


(C): 


(C) ; 


<C> 


D 


* •. X'J'/Xv1 '•  • v v . v , v a v . v.  ’ . ■ y//Av 


'''vXv'’'-'- 


:XK;:;X::-;X::v 


STORES 

DELIVERY 


A 


B 


97 


POSITIVE 
CONTROL  & 
LAUNCH 


DEVO  J 2 HR 


110 


BRIEFING 


DEV  B 1 HR 


ALL 

MANEUVERS 


DEV  3 4 HR 


DEBRIEFING 


DEV  B 1 HR 


113 


SECURE 

VDICE 


DEV  0 1 HR 


114 

POSITIVE 
CONTROL  & 
LAUNCH 


DEVO  4 HR 


HE 


(C) 


93 

BRIEFING 


ALL 

MANEUVERS 


DEV  B | 1 HR  I | DEV  3 | 4 HR 


(C) 


96 


SECURE 

VOICE 


DEV  0 1 HR 


97 


POSITIVE 
CONTROL  & 
LAUNCH 


OEVO  2 HR 


BRIEFING 


DEV  B I 1 HR 


SECURE 

VOICE 


DEV  0 1 HR 


99 


POSITIVE 
CONTROL  & 
LAUNCH 


DEV  D 4 HR 


x vf:  v ; 


X'X'i" 


V/.v/. 


\vw 

V.W 


.WWV.'VVV*. 

.V.'/AV.',V. 


H 
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3. 4. 3. 2 Proficiency  Maintenance  Training  (PMT) 

The  training  that  continues  after  the  crewmembers  graduate  from 
CCTS  is  primarily  for  the  purposes  of  maintaining  the  proficiency  of  combat 
ready  crews.  This  training  is  also  referred  to  as  operational  readiness 
training  (ORT) . Once  the  initial  (transition)  training  is  completed,  this 
continuation  training  is  required  to  assure  that  previously  acquired  skills 
and  knowledges  are  retained.  In  addition,  PMT  involves  the  instruction  of 
new  information  and  techniques  as  they  develop  (e.g.,  air  vehicle  hardware 
and  software  changes) . 

Rather  than  a sequence  of  instructional  blocks,  the  PMT  courses 
are  periodically  scheduled  training  sessions.  The  instructional  content  of 
the  session  is  determined  by  the  crew's  (or  crewmember's)  particular  capa- 
bilities and  limitations.  That  is,  there  are  often  large  individual  differ- 
ences among  crewmembers  with  respect  to  their  ability  to  retain  various  types 
of  information  and  maintain  particular  skills.  The  computer -managed  instruc- 
tion system  is  of  particular  value  in  evaluating  individual  and  crew  perform- 
ance data  so  that  the  PMT  training  sessions  may  be  structured  around  the 
crewmember's  (crew's)  particular  deficiencies. 

There  are  four  major  categories  of  instruction  into  which  PMT  can 
be  grouped.  The  first  category  involves  instruction  on  updates  to  the  B-l 
air  vehicle  system.  This  includes  both  systems  (e.g.,  controls  and  displays) 
and  procedures  (flight  handbook)  changes.  This,  as  well  as  refresher  instruc- 
tion, is  done  in  Device  0 (Carrel).  The  term  "academic"  instruction  has 
often  been  used  to  represent  this  type  of  material. 

The  second  category  of  instruction  pertains  to  the  acquisition  of 
new  procedure  skills  and  the  rehearsal  of  previously  acquired  normal  and 
emergency  procedures.  In  the  research  literature  involving  complex  tasks, 
it  has  been  illustrated  that  the  type  of  behaviors  referred  to  here  as 
procedural  tasks  suffer  from  more  rapid  "forgetting"  than  the  other  types  of 
tasks.  Procedural  tasks  also  tend  to  be  high  in  criticality.  It  is  highly 
desirable,  therefore  , that  normal  and  particularly  emergency  procedures  be 
practiced  with  relatively  short  inter-session  intervals.  This  practice  is 
accomplished  in  Device  2 (Procedures  Trainer). 

The  third  area  of  PMT  involves  the  practice  of  interactive  tasks 
that  require  complex  perceptual -motor  behavior  and  "real-time"  decision 
making.  These  behaviors  are  practiced  in  Device  3 (Part-Mission  Trainer), 
and  the  air  vehicle.  The  training  time  spent  in  the  air  vehicle  is  used  to 
train  only  those  behaviors  that  cannot  be  practiced  satisfactorily  in  ground- 
based  devices. 
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The  fourth  category  of  PMT  involves  an  integrated  crew  rehearsal 
ot  a complete  Emergency  War  Order  (EWO)  mission.  This  training  occurs  in 
Device  4 (Full-Mission  Simulator)  and  to  a limited  extent  in  the  air  vehicle. 
The  air  vehicle  is  limited  in  its  capability  to  provide  this  type  of  training 
as  discussed  in  Section  3.3.5. 

The  requirement  for  standardization  of  performance  evaluation 
criteria  are  very  important  for  both  operational  effectiveness  evaluation 
as  well  as  PMT  "course"  evaluation  and  modification.  An  example  of  this 
latter  concern  is  the  evaluation  of  instructor  and  examiner  reliability 
across  the  entire  B-l  training  system  (CCTS  and  PMT).  As  discussed  in  the 
section  on  device  requirements,  the  format  used  for  performance  measuring 
and  recording  must  be  compatible  at  both  CCTS  and  PMT,  as  well  as  with  the 
analysis  facilities  of  the  SAC  ISD  team. 

There  are  many  configurations  that  PMT  can  assume.  One  configura- 
tion involves  the  crewmembers  performing  all  of  their  proficiency  training 
at  their  individual  MOB.  This  is  generally  referred  to  as  "decentralized" 
PMT.  In  this  configuration,  each  MOB  must  have  sufficient  numbers  of  all  of 
the  devices  to  support  PMT.  An  alternative  configuration  involves  all  of 
the  crews  traveling  (TDY)  to  a "centralized"  location  for  periodic  PMT.  In 
this  case, the  individual  MOB  has  no  training  devices  other  than  the  air 
vehicle.  The  central  training  facility  (i.e.  CCTS),  however,  has  sufficient 
numbers  of  devices  to  support  PMT  for  the  entire  B-l  fleet. 


The  former  (decentralized)  configuration  has  the  advantage  of  fewer 
personnel  logistics  problems  and  lower  TDY  costs.  The  former  also  has  the 
pedagogical  advantage  of  utilizing  temporally  spaced  practice  rather  than 
massed  practice  (e.g.,  once  a month  versus  three  times  once  every  quarter). 
The  lesser  training  effectiveness  of  the  centralized  (periodic)  training  con- 
cept results  in  somewhat  more  air  vehicle  flying  time  being  required  to  main- 
tain proficiency.  However,  significant  initial  investment  cost  savings  and 
logistical  support  advantages  can  be  experienced  in  the  centralized  config- 
uration. For  example,  more  efficient  utilization  can  be  gained  by  centra- 
lization when  each  MOB  requires  only  partial  utilization  (e.g.,  1/3  of  a 
Full-Mission  Trainer -Device  4).  Similarly,  the  logistics  involved  in  the 
supply  of  replacement  and  spare  parts,  as  well  as  maintenance  personnel, is 
an  advantage  of  centralization. 


There  are  obviously  many  PMT  configurations  that  lie  between  the 
totally  centralized  and  decentralized.  An  example  of  a partially  centralized 
case  is  to  have  the  simpler  devices  (carrels  and  procedures  trainers)  at  the 
MOB  for  frequent  utilization,  while  having  the  complex  devices  (Part  and  Full- 
Mission  Trainers)  at  mly  the  centralized  location  to  be  used  on  a less 
frequent  basis.  This  latter  case  effectively  utilizes  the  lower  cost,  aca- 
demic and  procedures  devices  in  those  behaviors  appropriate  for  the  devices 

m°re  f^equent  rehearsal  to  ensure  retention.  The  behaviors  practiced 
m the  more  costly  trainers,  on  the  other  hand,  are  retained  longer  so  less 
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frequent  (e.g.,  quarterly)  practice  is  appropriate. 

„ . ">ther  partially  centralized  concept  consists  of  a number  of 

Tnvniraln.Z^"JOCations  rather  than  only  one’  50  that  some  crews  require. 

TDY  for  PMT  while  others  do  not.  Another  aspect  of  partially  centrali- 
zing PMT  is  to  have  only  some  of  the  crews  at  each  MOB  travel  to  a central 
location.  For  example,  if  a MOB  requires  the  use  of  one  and  one-half  of 
a certain  device,  it  might  be  appropriate  to  have  one  of  those  devices 
at  the  MOB  and  send  one  third  of  the  crews  to  a centralized  training  facility. 
The  factors  that  are  affected  by  these  aspects  of  centralization  are  the 
previously  discussed  travel  costs  and  the  logistical  support  considerations. 

rough  the  use  of  various  centralization  schemes  involving  the  distribution 
o individuals,  devices,  and  central  locations,  optimum  utilization  of  the 
devices  can  be  established  across  the  B-l  system. 


Within  these  ''centralization"  configurations, 
selected  to  represent  practicable  configurations  for  B- 
urations  are  illustrated  in  Table  5.  Case  I represents 
case  in  which  each  MOB  has  sufficient  training  devices 
case  requires  one  five-hour  flight  per  crew  per  month, 
are  assumed  to  be  "training  efficient."  That  is,  many 
logged  during  missions  such  as  ferrying  flights  are  not 
ing  efficient  training. 


four  cases  have  been 
1 PMT.  These  config- 
the  decentralized 
to  provide  PMT.  This 
These  flight  hours 
of  the  hours  that  are 
considered  as  provid- 


As  previously  discussed,  PMT  curricula  are  comparable  on  three 
points:  academic,  procedures  practice,  and  "stick  time"  (time  in  Devices  3, 
A,  or  airborne).  The  PMT  illustrated  in  Case  I utilizes  8 hours  per  month 
ot  academic  training  (e.g.,  one  hour  sessions,  twice  per  week).  Normal  and 
emergency  procedures  are  practiced  six  hours  per  month  (two  hour  sessions  at 

S0?lmately  10  day  sPacings)-  stick  time  for  Case  I is  17  hours  per  month 
(204  hours  per  year). 


The  second  configuration.  Case  II,  is  identical  to  Case  I with  the 
exception  that  two  flights  of  four  hours  are  used  rather  than  the  one  five- 
.lght  in  Case  }•  It  is  judged  that  one  five-hour  flight  per  month  is 
su  icient  to  maintain  proficiency  on  the  behavioral  objectives  that  cannot 
be  satisfied  in  ground-based  devices.  However,  Case  II  corresponds  to  the 
current  operational  concept  which  cites  two  four-hour  flights  per  month  for 


Case  III  represents  a "partially  centralized"  configuration.  That 
is,  it  is  centralized  with  respect  to  the  fact  that  all  crews  periodically 
travel  to  one  or  more  central  base(s)  to  practice  on  the  part  and  full  mission 
trainers.  It  is  only  "partially"  centralized  in  that  the  lower  complexity 
deyiMAD  ^ca^els  and  Procedures  trainers)  are  located  at  each  of  the  individ- 
ual MOBs.  The  academic  and  procedures  rehearsal  times  are  the  same  as  in 
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Case  I (eight  and  six  hours,  respectively).  In  addition,  the  "stick  time" 
per  year  is  approximately  the  same  as  Case  I (204  hours).  However,  in 
Case  II,  only  the  air  vehicle  flight  sessions  are  evenly  distributed  over 
time  (approximately  two  week  intervals)  with  the  part  and  full  mission 
trainer  sessions  being  massed  together  on  a quarterly  basis. 

The  fourth  configuration  represents  a situation  where  the  acquisi- 
tion costs  are  minimized  by  not  using  any  complex  devices  for  PMT.  However, 
proficiency  is  maintained  through  greater  use  of  the  air  vehicle  which 
results  in  very  high  life-cycle  costs.  The  academic  and  procedures  times 
for  this  case  are  the  same  as  the  other  configurations.  The  "stick  time"  is 
also  approximately  the  same  (211  hours/year).  There  are  training  limitations 
to  this  case  which  are  discussed  in  Section  3.4.2, 

The  times  illustrated  in  Table  5 were  determined  on  the  basis  of 
a review  of  other  military  proficiency  programs  in  conjunction  with  the  B-l 
behavioral  objectives  for  which  proficiency  must  be  maintained.  Particularly 
with  respect  to  PMT,  subsequent  program  evaluation  and  refinement  by  an  ISD 
team  is  essential. 

3. 4. 3. 3 Upgrade  Training--Copilot  to  Pilot 

Two  alternative  approaches  to  copilot  upgrade  training  were  con- 
sidered. One  approach  involved  the  copilots  returning  to  CCTS  for  upgrade 
training.  The  second  approach  involved  the  upgrading  of  copilots  to  pilots 
at  the  MOB  during  PMT.  The  primary  advantage  of  the  first  alternative  is 
crew-coordination  involved  in  experiencing  the  other  crewmembers'  "idiosyn- 
crasies" ( as  opposed  to  equipment  dependencies).  The  advantage  of  the 
second  alternative  is  cost  savings. 

The  training  objectives  relating  to  systems  and  procedures  knowl- 
edge are  the  same  for  both  pilots  and  copilots.  Both  of  the  crewmembers 
graduate  from  CCTS  with  this  knowledge.  The  differences  between  the  postions 
reside  in  the  "proficiency"  levels  (criteria)  that  they  attain  in  precise 
perceptual -motor  behaviors  (e.g.,  refueling  and  landing).  That  is,  the  co- 
pilot has  all  of  the  "knowledge"  required  of  the  pilot  but  requires  addition- 
al "experience"  to  meet  the  criteria  to  be  met  by  pilots. 

Particularly  due  to  the  symmetry  of  the  instrumentation  (including 
controls)  within  the  B-l,  copilots  receive  this  experience  through  operation- 
al (PMT  and  operational  readiness  inspection)  activities.  It  is  recommended, 
therefore,  that  pilot  upgrade  training  (PUP)  be  accomplished  during  PMT  as 
opposed  to  TDY  at  CCTS.  That  is,  the  upgrade  training  is  a natural  result  of 
normal  proficiency  training  during  which  time  the  copilots  are  given  suffi- 
cient time  to  increase  their  proficiency  to  pilot  standards.  The  crew  co- 
ordination aspect  of  having  the  upgrade  training  at  the  CCTS  are  outweighed 
by  the  cost  and  scheduling  implications  of  that  approach. 
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Section  4 


ANALYSIS  OF  TRAINING  SYSTEMS 


4.1  INTRODUCTION 

4.1.1  General  Discussion 

Analysis  of  a system  is  performed  to  discover  the  relationship 
between  the  performance  of  its  components  and  the  overall  system  performance. 
In  this  training  system  analysis,  the  overall  performance,  and  the  proficiency 
of  the  graduates  is  taken  as  given.  That  is,  all  graduates  should  have  demon- 
strated that  they  possess  the  skills  and  knowledge  needed  to  successfully  per- 
form their  roles  in  the  operation  of  the  air  vehicle.  A measure  of  effective- 
ness of  next  importance  for  this  study  then  is  the  cost  of  the  system.  This 
analysis  has  considered  that  the  most  significant  cost  is  that  of  the  ip-Y^ar 
life  cycle.  The  particular  period  which  we  identify  as  the  life  cycle  is  19 
through  the  end  of  1989.  Costs  are  also  broken  out  by  categories  in  RDT£E, 
0$M,  etc. 

The  parameters  of  the  problem  are  determined  by  externally  imposed 
policy,  as  well  as  (internally)  by  the  design  of  the  training  system  in  the 
instructional  system  design.  The  analyst  manipulates  a model  of  the  system 
by  changing  its  parameters  (both  external  and  internal)  in  order  to  under- 
stand the  system  and  thereby  to  optimize  the  measure  of  effectiveness.  In 
the  present  case,  one  hopes  to  find  the  training  system  which  has  the  least 
cost.  Manipulation  of  the  external  parameters  can  provide  data  for  other 
analyses  which  seek  to  determine  the  optimum  of  some  more  extensive  system, 
for  example,  the  total  B-l  aircraft  systems,  or  the  Air  Force  as  a whole. 

The  results  of  the  instructional  system  design  provided  a limited 
number  of  parameters  which  could  be  manipulated.  Typically,  the  media  which 
were  specified  for  a given  instructional  block  were  limited  to  a single  de- 
vice. The  given  device  or  other  devices  in  an  ascending  hierarchy  of  more 
sophisticated  and  expensive  devices  could  be  used.  However,  the  cost  asso- 
ciated with  the  next  level  of  complexity  is  an  order  of  magnitude  larger 
than  the  given  device.  Thus,  there  is  little  likelihood  that  substitution 
of  more  complex  devices  for  simpler  devices  could  lower  overall  costs.  Sub- 
stitution of  time  in  an  aircraft  for  time  in  a trainer  was  one  possibility 
which  was  explored,  but  no  immediate  savings  were  possible. 

Results  were  obtained  for  variation  in  the  crew  ratio  and  for 
several  basing  concepts.  These  results  revealed  that  the  costs  for  any  of 
the  basing  concepts  could  be  made  comparable  and  that  the  number  of  trainees 
(through  the  action  of  the  crew  ratio  parameter)  had  a strong  influence  on 
life-cycle  costs.  Cost  details  of  the  results  are  contained  in  Appendix  A, 

Volume  2. 
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4.1.2  Approach 


The  approach  to  "the  analysis  of  the  B-l  aircrew  training  system  was 
to  compare  alternatives  to  a baseline  system  concept  . The  baseline  incorpor- 
ated Air  Force  preferred  or  given  B-l  operational  parameters  and  the  program- 
med-derived  recommended  training  system.  The  effects  of  other  system  para- 
meters are  treated  as  perturbations  on  the  basic  concept.  No  real  distinction 
is  made  between  externally  influenced  parameters  and  internally  influenced 
parameters,  since  the  command  level  at  which  control  is  exercised  should  be 
obvious.  The  methodology  is  documented  in  sufficient  detail,  and  the  computer 
programs  are  available  to  the  Air  Force  so  that  other  concepts  and  parameter 
values  can  be  examined  easily.  This  study  has  provided  a number  of  results, 
a methodology  for  performing  an  economic  analysis,  data  required  for  further 
analysis  and  an  automation  of  the  principal  computations. 

The  analysis  of  a training  system  concept  is  in  terms  of  resource 
use  and  is  performed  by  the  TRAM  or  TROLIE  programs.  The  assignment  of  costs 
is  accomplished  by  Phase  4 of  TRAM  which  is  also  used  by  the  TROLIE  program. 
TRAM  and  TROLIE  are  described  in  Technical  Memoranda  SAT-5  and  SAT-6. 

The  approach  to  deriving  cost  data,  the  values  used  and  detailed 
listings  of  the  results  of  the  economic  analysis  are  contained  in  Appendix  A 
CVol.  2). 


The  principal  alternatives  with  respect  to  media  considered  involve 
the  substitution  of  the  B-l  aircraft  for  the  full-mission  trainer  and  part- 
mission  trainer  as  a part  of  the  proficiency  maintenance  program.  Using  a 
roughly  1:1  trade-off  between  ground  trainer  and  aircraft,  (which  is  a conser- 
vatively low  estimate,  considering  the  training  to  be  accomplished),  it  was 
found  that  minimization  of  aircraft  time  is  equivalent  to  optimization  of  the 
system. 


The  number  and  time  phasing  of  crew  training  is  determined  by  the 
number  of  combat  aircraft  and  the  crew  ratio,  the  ratio  of  qualified  combat 
crews  to  combat  aircraft,  and  by  attrition.  It  was  found  that  the  life  cycle 
cost  varies  strongly  with  the  crew  ratio  since  the  operations  and  maintenance 
costs  associated  with  proficiency  maintenance  flying  dominate  the  life-cycle 
cost. 

4.2  BASELINE  SYSTEM 

4.2.1.  Baseline  Concept 

The  baseline  system  provides  a benchmark  with  which  other  candidate 
system  concepts  can  be  compared.  The  baseline  is  designed  to  incorporate  as 
closely  as  possible  the  current  B-l  operational  concepts  and  to  represent  the 
independently  derived,  lowest  cost  training  concept.  Comparison  of  the  cost 
of  the  baseline  system  with  the  cost  of  other  candidate  systems  provides  a 
means  for  evaluating  non -monetary  costs.  For  example,  the  baseline  system 
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uses  one  training  flight  per  month  for  Proficiency  Maintenance  Training. 

This  is  the  major  difference  between  the  baseline  system  and  the  current 
concept  of  operations.  Comparison  of  the  cost  of  the  baseline  system  with 
the  alternative  system  using  two  flights  per  month  reveals  the  cost  of  the 
additional  flight.  The  decision-maker  can  then  weigh  the  value  of  the 
extra  flight  with  respect  to  its  marginal  cost  to  determine  if  he  wishes  to 
continue  the  two-flight  per  month  policy. 

4.2.2.  Description  of  the  Baseline  System 

The  baseline  system  involves  7 MOBs.  Six  of  the  MOBs  have  a full 
wing  (30  UE  aircraft).  The  CCTS  base  has  a CCTS  squadron  (15  UE  aircraft) 
and  a squadron  of  combat  aircraft.  The  first  four  vehicles  are  research  and 
development  prototypes.  The  first  mission-capable  aircraft  is  delivered  to 
the  CCTS.  Aircraft  are  then  delivered  at  an  accelerating  rate  up  to  a maxi- 
mum of  4 per  month  to  the  6 MOBs  with  full  wings,  one  base  at  a time. 

Finally,  the  squadron  of  combat  aircraft  are  delivered  to  the  CCTS  base. 

Tables  6 and  7 illustrate  the  B-l  activation  schedule  and  establishment  of 
bases,  respectively.  CCTS  training  demands  for  "new"  crews  occur  upon  deliv- 
ery of  aircraft  to  a base.  Later,  CCTS  training  demands  occur  for  replacement 
crews  in  order  to  maintain  the  desired  crew  ratio  when  attrition  occurs. 

Attrition  is  modeled  as  a percentage  of  the  crews  at  a given  base. 

The  nominal  tour  of  duty  is  three  years.  For  a variety  of  reasons,  attrition 
actually  starts  immediately  upon  graduation.  As  a crude  approximation  to 
these  effects,  a delay  of  two  years  is  introduced.  This  results  in  an  ex- 
pected tour  of  duty  for  all  trainees  of  about  three  years,  depending  upon  the 
details  of  the  delivery  schedule  for  the  particular  base.  In  steady  state  , 
the  average  tour  of  duty  is  the  reciprocal  of  the  attrition  rate.  If  all  air- 
craft are  delivered  at  about  the  same  time,  the  average  tour  of  duty  of  the 
initial  crews  is  3.2  years.  The  steady  state  tour  of  duty  is  based  upon  a 
30%  attrition  rate  so  the  steady  state  tour  of  duty  is  3-1/3  years. 

In  addition  to  attrition  losses,  the  supply  of  copilots  suffers  add- 
itional attrition  as  candidates  for  upgrading  to  pilot  are  selected.  An 
additional  20%  of  the  copilots  are  assumed  to  undergo  attrition  for  this  pur- 
pose. Thus,  in  the  steady  state,  2/3  of  the  pilots  will  be  obtained  by  upgrad- 
ing of  copilots.  The  copilot  average  tour  of  duty  is  reduced  to  two  years  in 
steady  state. 

The  training  program  for  a given  position  is  called  a course.  With- 
in a course,  syllabi  for  a number  of  tracks  were  planned.  A separate  track  is 
defined  for  each  of  the  major  sources  of  trainees  available. 

The  sources  of  trainees  are  prioritized  for  each  crew  position  as 
illustrated  in  Table  8.  The  training  system  calls  upon  the  highest  priority 
sources  until  it  is  exhausted,  then  goes  to  the  next  highest,  etc.  The 
sources  and  priorities  are  given  in  Table  9 as  derived  from  discussions  with 
SAC  personnel.  For  example,  the  introduction  of  UPTs  into  the  B-l  training 
program  is  delayed  until  1983.  This  is  reflected  in  the  time-phased  demand 
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Table 


6 


B-l  Activation  Schedule 


Total  in 

Start  Date  End  Date  Rate/Month  Period  Destination 


Apr  79 

Dec  79 

-- 

Jan  80 

May  80 

1 

Jun  80 

Oct  80 

2 

Nov  80 

Nov  80 

2 

Dec  80 

Mar  81 

3 

Apr  81 

f—4 

oo 

‘H 

£ 

Apr  81 

(Final 

Delivery) 

4 

5 

R$D 

5 

CCTS 

10 

CCTS 

2 

12 

1st  Operational 
Wing 

1 

180 

Other  MOBs 
(15/wing 
2/wings/base) 

Table  7 

Establishment  of  Bases 


Base 


B-l  Deliveries 


CCTS  1980 

1 1980-1981 

2 1981-1982 

3 1982 

4 1982-1983 

5 1983-1984 

6 1984 

7 (15  UE  co-located  1984-1985 

with  CCTS) 


Table  8 


Source  Priority  and  Capacity 


Priority 

Pilot 

Copilot 

OSO 

DSO 

1st 

Copilot 
20%  of  fleet 

B-52  Copilot 
96/year 

FB-111  R/N 
12/year 

B-52  EWO 
96/year 

2nd 

FB-111  Pilot 
12/year 

UPT  Unlimited 
avail  at 
1982 

B-52  R/N 
192/year 

EWOT  Un- 
limited 

3rd 

B-52  Pilot 
96/year 

KC-135  Copilot 
360/year* 

UNT* 

Unlimited 

4th 

KC-135  Pilot 
Unlimited** 

Never  used 

Limited  use 

Table  9 

Overall  Training  Demand  Schedule 


Year 

UE 

Deliveries* 

Total  UE 
AV's 

Total 

Crews 

New 

Crews 

Trained 

Rep 

Crews 

Trained 

Total 

Crews 

Trained 

Copilot 

Upgrades 

1980 

5 

5 

10 

10 

0 

10 

0 

1981 

45 

50 

100 

90 

0 

90 

0 

1982 

48 

98 

196 

96 

3 

99 

1 

1983 

48 

146 

292 

96 

30 

126 

10 

1984 

48 

194 

388 

96 

59 

155 

20 

1985 

1 

195 

390 

2 

88 

90 

29 

1986 

- 

195 

390 

- 

116 

116 

39 

1987 

- 

195 

390 

- 

117 

117 

39 

1988 

- 

195 

390 

- 

117 

117 

39 

1989 

- 

195 

390 

117 

117 

39 

* Excluding  CCTS 
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schedule  (Table  9)  and  the  availability  of  the  source  (Table  10).  B-l  copilot 
upgrade  to  pilot  is  preferred  over  all  sources  since  no  CCTS  training  is  re- 
quired for  this  transition  given  that  the  copilot  has  served  as  a copilot  for 
two  years  (which  is  guaranteed  by  the  attrition  model  assumed), 

?„f  it  izZctiiiiVoT. 

The  £^4  3, 

are'attributed'to  ^ C°Sting  PUrP0Se'S’  ^ duPlicated  times 

except  ls  not  decentralization,  but  the  low  number  of  fUghf  hours  reared 
Flight  time  is  reduced  by  the  extensive  and  regular  use  of  trained  at  t^ 

the^ost"  fPfr  ^ h,igh  ac<luisition  operating  expenses  for  the  trainers 
the  cost  of  flight  time  dominates  the  life  cycle  cost.  trainers, 

joined  wit™thatSo°?rtheUr^f  ^ CCTS  baSe  by  the  “P^ational  squadron  is 
J with  that  of  the  CCTS.  By  assuming  that  the  MOB  at  the  CCTS  base  is 

eployed  last,  the  requirement  for  PMT  on  the  CCTS  devices  is  built  up  just 

as  the  requirement  for  CCTS  initial  crews  goes  to  zero.  This  approach  con 

founds  the  separation  of  PNfr  from  CCTS  costs  but  reduces  the  acquisition 

costs  through  more  efficient  use  of  the  available  tracing  devils 

4,2,3  devices  Required  by  the  Recommended  Instructional  System  (with 
Baseline  Assumptions) 


instructional'  ™tem  ?s  sSHn  the  recoi™?nded 

. rrTC  . ^ 3 wn  in  lable  12.  The  additional  devices  required  a 

lf  a co~ located  operational  squadron  is  to  share  resources  with  the 
CCTS  is  shown  separately  from  the  CCTS  requirements  alone. 


The  maximum  use  of  an  instructional  device  is  known  as  its  yield. 
The  yield  of  various  devices  varies  with  the  type  of  device.  The  trainers' 
at  MOBs  are  programmed  for  greater  yield  than  the  trainers  at  CCTS  since  a 
certain  amount  of  make-up  work  and  instructor  training  is  accomplished  at 
CCTS.  Table  13  lists  the  assumed  yield  of  each  type  of  device. 
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Resource  Use  by  Track  (hours) 
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T TABLE  12 

' Number  of  Devices  Required 


FACILITY 

CCTS  Without  A CCTS  With  Co-  MOB 

DEVICE  Co-located  MOB  Located  MOB  (15  UE)  (30  UE) 


0 - Carrel  9 

1 - Familiarization  4 

2 - Procedures  P/CP  2 

0S0  3 

DSO  2 

3 - Part-Mission  P/CP  1 

OSO  1 

DSO  2 

4 - Full-Mission  1 


13 

4 

2 

3 

2 

2 

2 

2 

2 


8 

0 

1 

1 

1 

1 

1 

1 

1 


TABLE  13 


0 

0 

i: 


Device  Yield 


Yield 

Device  (Hrs/Year) 


Briefing  Room  3000 
General  Purpose  Carrel  3000 
Familiarization  Trainer  3000 
Procedures  Trainers  4000 
Part-Mission  Trainers  (at  CCTS)  4000 
Part-Mission  Trainers  (at  MOB)  5000 
Full -Mission  Trainers  (at  CCTS)  4000 
Full-Mission  Trainers  (at  MOB)  5000 


r 


93 


4.2.4 


Personnel 


Instructors  are  assumed  to  have  the  rank  of  Major.  Half  of  an 
instructor's  time  is  attributed  to  overhead  consisting  of  analysis  of  trainee 
progress,  upgrading  of  instructional  material  (excluding  actual  preparation), 
other  military  duties,  leave,  etc.  Instructor  time  associated  with  each 
device  is  given  in  Table  14. 


The  general-purpose  carrel  room  has  a GS-11  technician  assigned. 
The  familiarization  trainer  has  20%  of  a GS-11  technician  assigned.  Other 
devices  assume  technician  costs  as  a part  of  the  0§M  costs. 


Table  14 

Instructor  Support  by  Device 


Device 

Pilot -Copilot 
Full  Crew  Pair 

Copilot -Copilot 
Pair 

Single 

Trainee 

Briefing  Room- 
Genera  1 

IP,  IOSO, 
I DSO 

1 IP 

1 IP 

1 Instructor 

Briefing  Room- 
MSN  Plan 

1/6  of  (IP, 
IOSO,  I DSO) 

-- 

-- 

-- 

Full-Mission 

Trainer 

IP,  IOSO, 
I DSO 

-- 

IP 

__ 

Part -Miss ion 
Trainer 

_ — 

IP 

IP 

Procedures 

Trainer 

1/2  Instructor 

1/2  IP 

1/2  Instructor 

Aircraft 

2 Instructors 

IP 

IP 

-- 

IP  = Instructor 

Pilot 

IOSO  = Instructor  OSO 
1DS0  = Instructor  DSO 
Instructor  - any  of  the  above 
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4.2.5 


Trainer  Maintenance  Personnel 


In  the  course  of  the  SAT  analysis,  trainer  maintenance  requirements 
have  been  considered  and  have  led  to  the  following  conclusions  regarding  the 
type  of  personnel  to  be  employed  for  that  function.  The  basic  problem  is  to 
choose  the  appropriate  point  on  the  continuum,  which  goes  from  all-contractor 
personnel  (presumably  the  contractor  who  built  the  trainer)  to  all-in-house 
personnel  (Air  Force  personnel  trained  in  hardware  and/or  software  maintenance 
of  training  devices).  These  factors  are  generally  those  considered: 

1.  In-house  personnel  need  to  be  replaced  more  often  than  do 
contractor  personnel  (due  to  attrition,  etc.). 

2.  Contractor  personnel  have  better  sources  of  technical 
knowledge  and  replacement  parts. 

3.  Contractor  personnel  are  placed  in  an  unduly  advantag- 
eous position  to  monopolize  further  procurements  and  modi- 
fications. 

Calspan  advocates  a compromise  position,  in  combination  with  what 
is  believed  to  be  a Department  of  Defense  trend  towards  the  purchase  of  war- 
ranties for  trainers.  It  is  apparant  that  contractor  personnel  are  most 
effective  in  repairing  major  malfunctions,  but  are  not  necessarily  more 
effective  than  in-house  (Air  Force)  personnel  in  day-to-day  software  and  hard- 
ware maintenance.  For  the  purpose  of  major  modifications  to  the  trainer 
system,  a combination  of  the  contractor's  knowledge  of  the  technical  nature 
of  the  modification  can  be  efficiently  coupled  with  the  in-house  knowledge  of 
the  operational  requirements. 

The  recommended  maintenance  concept  is  therefore: 

1.  Purchase  warranty  coverage  to  provide  contractor 
personnel  for  the  unscheduled  maintenance  and  repair. 

2.  Employ  contractor  personnel  to  assist  in-house 
personnel  during  the  installation  of  the  system  and 
subsequent  major  modifications. 

3.  Use  in-house  personnel  for  routine  maintenance 
and  modifications. 

This  arrangement  tends  to  optimize  each  of  the  factors  mentioned  at 
the  start  of  this  section,  namely: 

1.  In-house  personnel  will  tend  to  stay  in  the  service  longer 
since  there  is  no  ready-made  (nor  economically  secure)  job 
waiting  for  them  with  the  contractor  (i.e.,  doing  the  same  job 
in  the  same  place,  but  as  a civilian). 


2.  Contractor  personnel  are  called  in  only  when  their 
technical  expertise  is  needed. 

3.  Contractor  personnel  are  not  placed  in  the  position 
of  being  the  only  individuals  who  know  the  complexities 
of  the  system,  nor  do  they  become  especially  privy  to 
privileged  information  regarding  future  plans  of  the 
Air  Force. 

Ih  order  to  maintain  the  greatest  flexability  in  tho  manipulation 
ot  the  data,  trainer  0$M  costs  are  carried  as  a dollar  cost  without  specific 
manning  associated  with  the  devices. 


4 . 3 COST  CATEGORIES  ‘ 

The  costs  for  a system  can  be  organized  in  many  ways.  The  particu- 
lar organization  used  here  is  based  in  part  on  Air  Force  methodology  and  in 
part  on  the  need  to  provide  simple  algorithms  for  mechanization  of  the  compu- 
tation. Details  on  the  techniques  used  to  estimate  the  parts  of  the  system 
are  given  in  Appendix  A. 

In  general,  a first  unit  hardware  cost  must  be  estimated  for  each 
device.  Other  costs  which  can  be  directly  associated  with  the  development, 
acquisition  and  operation  of  the  device  are  calculated  from  this  by  cost 
estimating  relationships  (CERs) . Instructors  required  to  teach  the  courses 
are  then  estimated.  Facilities  costs  are  obtained  by  considering  the  type  of 
facility  required  for  each  of  the  devices,  and  the  instructor  officers  needed. 

The  cost  categories  considered  are  RDT$E,  acquisition,  recurring 
support,  operations  and  maintenance,  facilities  acquisition,  and  instructional 
material.  RDT£E  consists  of  all  the  costs  required  to  put  the  first  unit  in 
the  field,  excluding  only  the  instructional  material.  Acquisition  consists 
of  the  cost  of  all  remaining  systems.  Recurring  support  consists  of  upgrade 
and  modification  costs. 


Facilities  are  estimated  as  new  construction  at  CCTS,  and  for  the 
trainers  at  the  MOBs.  Existing  facilities  are  assumed  for  the  carrels  at 
the  MOBs.  Instructors  are  assumed  to  be  available  for  PMT  in  the  decentral- 
ized concept.  The  partially  centralized  concept  requires  specifically 
assigned  instructions  for  the  PMT  training. 


Instructional  material  can  represent  a significant  initial  (and 
recurring)  cost  and  might  reasonably  be  taken  as  part  of  RDT$E.  However, 
since  there  will  be  a distinct  difference  in  the  source  of  funds  for  the 
initial  instructional  material  and  the  RDT§E,  the  separation  is  deemed  useful. 
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A general  analysis  of  the  life-cycle  costs  of  the  recommended  train- 
ing system,  including  a detailed  breakdown  of  the  costs  of  the  individual 
components,  is  given  in  Appendix  A. 


4.4  ALTERNATIVE  TRAINING  SYSTEMS 

In  addition  to  the  baseline  system,  the  analysis  examined  modifica- 
tion of  the  PMT  training,  alternate  basing  concept,  variation  in  the  crew 
ratio,  and  a variation  in  the  replacement  model. 


4.4.1  Modification  of  the  PMT  Training 

Three  alternatives  were  investigated. 

• Replacement  of  the  part-task  trainer  and 
full-mission  trainer  time  by  aircraft  time 

• Quarterly  recurrent  training  using  partially 
centralized  training  facilities 

• Increased  (to  AF  planning  factors)  flying 
time. 


Replacement  of  the  part-task  trainer  and  full-mission  trainer  with 
aircraft  time  greatly  decreased  the  acquisition  costs.  The  price  one  has  to 
pay  for  this  decrease  is  in  an  increased  cost  for  flying  time  (see  Appendix 
A).  The  increase  in  0$M  completely  overshadows  the  saving  in  acquisition 
costs  Similarly,  the  replacement  of  the  full-mission  trainer  with  aircraft 
time  is  not  cost  effective  over  the  life  cycle.  Additionally,  both  of  these 
alternatives  are  not  training  effective  since  many  dangerous  maneuvers  cannot 
be  practiced  in  the  air  vehicle. 


Quarterly  recurrent  training  at  a set  of  two  training  bases  (e.g., 
co-located  with  maintenance  depots)  introduces  increased  costs  to  provide 
TDY  and  transportation,  as  well  as  special  training  facility  instructors 
which  in  the  baseline  case  are  assumed  to  be  other  combat  crewmen.  There  is 
a small  acquisition  saving  using  this  concept.  However,  it  is  necessary  to 

increase  the  flying  time  in  between  trips  to  the  training  facility.  The  cost 
of  flying  aircraft  prevented  any  saving  in  life-cycle  costs. 


The  current  concept  of  employment  calls  for  two  four-hour  missions 
per  month,  per  crew.  The  recommended  system  requires  only  one  five-hour 
mission.  Data  contained  in  Appendix  A show  the  expected  result  that  costs 
incurred  are  extremely  sensitive  to  flying  time. 
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4.4.2  Basing  Concepts 

The  basic  unit  of  deployment  is  the  squadron  of  15  aircraft.  A set 
of  logical  combinations  of  squadrons  was  established  consisting  of  CCTS  and  a 
single  squadron  of  combat  aircraft  at  one  base  with  between  4 and  12  other 
bases.  Calculations  showed  that  one  needs  about  half  a full-mission  trainer 
and  half  a set  of  part-mission  trainers  per  squadron.  Therefore,  all  basing 
concepts  are  about  equivalent.  The  baseline  case  was  the  most  efficient  be- 
cause it  used  both  types  of  trainers  at  nearly  full  capacity.  The  single 
squadron  bases  used  a single  full-mission  trainer  half  time  and  separated  it 
for  individual  use  as  a set  of  part -task  trainers  for  the  other  half  of  the 
time.  The  5-base  concept  needed  1 1/2  full-mission  trainers  and  hence  was 
more  expensive  than  the  baseline  case.  The  number  of  devices  required  as  a 
function  of  the  number  of  squadrons  at  the  MOB  is  illustrated  in  Table  15. 
The  important  point  is  that  basing  concepts  have  only  minor  effects  on  life- 
cycle  costs. 


Table  15 


PWT  Facilities 


L! 

0 


fi 

SI 


0 


No.  of  Squadrons 
at  MOB 

Carrels 

Procedures 

Trainers 

Part-Mission 

Trainers 

Full-Mission 

Trainers 

1 

4 

1 

0 

1 

2 

8 

1 

1 

1 

3 

12 

2 

1 

2 
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A Modification  in  the  Replacement  Algorithm 


Referring  again  to  Table  9,  it  shows  the  flow  of  activity  in  the 
training  system.  A modification  in  the  system  was  introduced  which  limited 
the  total  full  crews  trained  per  year  to  120.  Attritees  which  could  not  be 
replaced  were  deferred  until  the  next  year.  That  is,  the  tour  of  duty  for  any 
airman  was  extended  if  he  could  not  be  replaced  by  the  limited  CCTS.  The 
results  of  this  exercise  indicate  a total  of  70  crew-years  were  delayed  (the 
same  total  training  was  administered).  The  results  further  show  that  each 
delayed  crew-man-year  is  worth  $64,000.  Even  greater  savings  are  possible 
if  the  total  trainees  are  reduced  by  this  technique.  It,  therefore,  appears 
that  strong  incentives  can  be  cost-effectively  applied  to  keep  airmen  from 
leaving  the  fleet. 


4.4.4  Alert  Rate  Calculations 

Alert  rate  is  a function  of  maintenance  effectiveness  and  personnel 
availability.  Maintenance  effectiveness  is  reflected  in  the  yield  in  missions 
per  unit  time.  During  this  study,  the  yield  of  the  aircraft  has  been  ex- 
pressed in  flight  hours  per  unit  time  and  missions  per  unit  time.  Thi  re  are 
factors  which  create  aircraft  down  time  which  are  dependent  on  the  number  of 
missions.  Refueling,  arming,  disarming,  warm-up  cool-down  time,  etc.,  reduce 
aircraft  availability  in  proportion  to  the  number  of  missions.  Overhaul  and 
periodic  maintenance  and  random  failures  generally  contribute  to  down-time  in 
proportion  to  aircraft  flight  hours.  Thus,  the  analysis  works  with  aircraft 
availability  on  the  basis  of  flight  hours,  as  well  as  total  flight  hours. 
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Aircraft  availability  is  expressed  as: 


(1-Ar)  Y 

MTU  = r 

LR 

where  MTU  = Maximum  training  use/unit  time/crew 

A„  = Alert  ratio 
K 

Y = Yield  in  hours/unit  time  or  missions/unit  time 

C„  = Crew  ratio 
K 


For  the  purposes  of  analysis,  alert  ratio  is  assumed  to  be  60%  and  a yield  of 
50  hrs/month  or  10  missions.  Thus,  with  the  baseline  crew  ratio  of  2,  the 
maximum  training  use  per  crew  is  2 missions  or  10  hours  per  month. 

For  the  case  of  variable  crew  ratio  which  was  investigated,  the 
maximum  alert  ratio  can  be  increased  with  decreasing  training  due  to  fewer 
crews  to  train. 


Solving  the 


above  formula  for  alert  ratio,  we  have: 


Y 

where  U is  the  programmed  training  use.  This  is  A = 1 
line  system  on  the  basis  of  missions  or  flight  hours. 


for  the  base- 


However,  aircraft  availability  is  not  the  only  limiting  factor. 

This  is  especially  true  for  the  use  of  a reduced  crew  ratio. 

The  model  for  air  crew  availability  for  alert  is  that  the  crew  will 
yield  48  weeks  of  active  duty  per  year.  The  remaining  four  weeks  are  annual 
leave  time.  The  time  required  for  training  on  the  part-  and  full-mission 
trainers  and  in  the  aircraft  is  the  programmed  time  plus,  an  hour  before  and 
after  these  training  events.  In  addition,  instructor  time  is  also  charged. 

It  is  assumed  that  an  instructor  can  monitor  two  trainees  in  all  training. 
The  required  hours  per  active  crewman  is: 


_ f!68  hrs/week)(Ap) 
“llPW  = CR 


52  weeks/yr 
48  work  weeks/yr 


+ 1-5  personnel  ,H  +h_+H„+2NJ  +CMD  hrs/week 
4 weeks/mo  A 3 4 


or: 


„ 182  An  3 

W - -CT"*  * 8 


(Ha  + H3  + H4  + ?N)  + OMD 
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Baseline  Values 


where  : H.  = 

A 


N = 
OMD  = 


Hours/crew/mo  in  the  aircraft 

Hours/man/mo  in  a part-task  trainer 

Hours/crew/mo  in  a full-mission  trainer 

Number  of  training  sessions  per  month 

Hours/man/week  for  other  military  duty,  sick 
leave,  etc. 

Alert  Ratio  (assumed  for  this  analysis) 

Crew  Ratio 


5 

6 
6 
6 

5 


0.6 


2.0 


In  PMT  concepts  requiring  TDY  to  a centralized  base  for  recurring  training  to 
use  Part-  or  Full-Mission  Trainers,  (H3+H4)  is  replaced  by  the  average  hours 
(per  month)  spent  on  TDY,  while  N refers  only  to  aircraft  sorties. 

Assuming  that  OMD  Sr  5 hours/week,  this  results  in  70.5  hours/crew/ 
week.  Although  this  appears  to  be  a large  number,  it  is  reasonable  consider- 
ing  that  crewmen  can  stand  alert  for  extended  periods  during  which  other 
^ties  can  occur  such  as  the  use  of  carrels  or  procedures  trainers,  eating 

PMT  concepts  16  illUStrates  the  alert  rat-‘  and  dutY  week  for  the  four 


4.4.5 


Crew  Ratio 


The  crew  ratio  parameter  was  systematically  varied  from  the  baseline 
case  of  2.0  down  to  1.0.  Over  the  10  year  life-cycle,  the  total  number  of 
crews  trained  is  directly  proportional  to  the  crew  ratio  (i.e.  half  as  many 
V crews  when  the  ratio  U 1.0).  The  corresponding  total  system  cost  at  a crew 
ratio  of  1.0  is  about  two-thirds  of  the  total  cost  at  a ratio  of  2.0. 

Table  17  illustrates  the  effect  of  crew  ratio  on  alert  rate. 

4.4.6  ' Conclusions  from  the  Economic  Analysis 

4.4. 6. 1 fleneral 
10 

A methodology  and  computer  program  capable  of  detailed  analysis  of 
B-l  training  systems  have  been  developed.  This  methodology  has  demonstrated 
its  utility  by  determining  factors  which  affect  the  life-cycle  and  other 
costs  of  training. 

Specific  conclusions  are  that  the  recommended  (baseline)  training 
system  is  a very  efficient  system,  that  B-l  flying  time  is  the  driving  factor 
in  the  life-cycle  costs,  that  the  costs  of  training  are  quite  sensitive  to 
the  number  of  crews  trained,  and  that  basing  concepts  do  not  influence  train- 
ing system  costs  appreciably. 

With  regard  to  cost  reduction,  a number  of  concepts  for  proficiency 
maintenance  were  evaluated  which  would  limit  acquisition  costs.  The  recom- 
mended PMT  concept  is,  however,  the  most  efficient  on  a life-cycle  cost  basis. 
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Table  16 
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Effect  of  Crew  Ratio  Variation  for  Recommended  Concept 


Crew  Ratio 


Parameters 

1.0 

1.27 

1.5 

1.75 

2.0 

(Baseline-) 

Total  full  crews 
trained 

520 

675 

780 

918 

1037 

Max.  Alert  rate 
(10  MSN/mo) 

0.90* 

0.87* 

0.85* 

0.83* 

0.80* 

Max.  Alert  rate  (A  ) 
(50  hrs/mo)  r 

0.90* 

0.87* 

0.85* 

0.83* 

0.80* 

Duty  Week  at 
0.6  Ar 

125 

102 

89 

78 

70 

A^  for  72-hour 
week  duty 

0.31 

0.39 

0.46 

0.54 

0.62 

★ 


duty  week  significantly  exceeds  72  hour/week. 


4.5  FACILITIES  REQUIRED  TO  SUPPORT  THE  B-l  TRAINING  SYSTEM 

4.5.1  Introduction 


The  purpose  of  this  section  is  to  identify  and  describe  the 
government  owned  real  property  requirements  implications  for  support  of  B-l 
aircrew  ground  training  at  the  Combat  Crew  Training  Squadron  (CCTS)  and  for 
proficiency  ground  training  at  the  MOB's.  These  facility  requirements  are 
limited  to  the  CCTS  academic-administration  and  simulator-training  buildings 
and  to  the  MOB  facilities  to  accommodate  devices  such  as  carrels,  procedure, 
part-mission,  and  full  mission  trainers.  Other  B-l  operational  and  training 
facilities  have  been  defined  in  the  Facilities  Requirement  Plan  (FRP)  pre- 
pared for  the  SPO  by  Calspan  in  FY  1975.  For  the  purposes  of  this  report, 
it  was  assumed  that  a 15  UE  MOB  is  colocated  with  the  CCTS.  The  MOB  shares 
the  training  devices  and  the  corresponding  facilities  of  the  CCTS  complex. 


The  three  facilities  described  in  this  section  have  been  configured 
to  accommodate  a level  of  training  activity  and  number  of  devices  which  are 
indicated  by  early  SAT  computations.  Later  study  through  the  use  of  the 
TRAM  program  resulted  in  a requirement  for  slightly  different  space  to  house 
equipment  and  functions,  which  are  noted. 

In  order  to  develop  facilities  implications,  a baseline  of  physical 
aspects  and  support  needs  for  training  devices  was  estimated  based  upon  state- 
of-art  equipment  currently  in  use  or  in  development  by  the  USAF,  USN,  commer- 
cial airlines,  aircraft  and  simulator  manufacturers.  A broad  spectrum  of 
training  devices  from  these  sources  has  been  analyzed  during  the  SAT  study 
and  a baseline  of  physical  characteristics  has  been  established  in  order  to 
define  the  facilities  needed  to  accommodate  this  equipment,  its  operations 
and  maintenance. 

Flight  Simulator  Building  AD-28-13-103  R-l  for  bomber  and  cargo 
aircraft  was  assessed  for  suitability  to  support  the  recommended  types  of 
trainers.  This  building  will  not,  in  its  present  design  or  an  economically 
feasible  modification,  support  modern-day  sophisticated  aircrew  trainers. 

For  this  reason  single  line  sketches  and  facilities  definitions  of  a CCTS 
and  MOB  simulator  facilities  were  developed  in  accordance  with  the  standard 
format  and  content  for  an  Air  Force  Facilities  Requirements  Plan. 

The  Mobile  Training  Detachment  Building  AD-38-19-01  is  not  an 
adequate  structural  arrangement  for  a CCTS  academic-administrative  facility 
because  it  was  designed  to  support  maintenance  technician  training  rather 
than  for  advanced  bomber  aircrew  needs.  Nor  does  the  Flight  Training  build- 
ing AD-28-16-19  or  any  other  building  described  in  AFM  88-2  meet  the  needs 
of  a B-l  CCTS  facility.  Therefore,  a description  and  single  line  sketch  of 
the  required  facilities  was  developed  and  is  presented  xn  Figure  13. 
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4.5.2 


CCTS  ACADEMIC-ADMINISTRATION  FACILITY 


4. 5. 2.1  Description 

This  facility  will  house  the  CCTS  Squadron  Commander,  administra- 
tion, Flight  Commanders,  Instructors,  learning  centers  with  carrels  and 
familiarization  trainers,  briefing/critique  rooms  and  Instructional  System 
Development  (ISD)  rooms.  A library  for  instructional  material  and  a computer 
management  instructional  room  are  also  provided. 

Flight  commander  and  instructor  offices  are  furnished  with  desks, 
file  cabinets,  a table  and  chairs  and  blackboard.  Briefing  rooms  are  sized 
for  (a)  an  instructor  and  one  or  two  students  and  (b)  an  instructor  crew  of 
three  and  student  crew  of  four.  These  larger  briefing  rooms  are  used  also 
for  mission  planning.  Because  this  facility  is  a squadron  headquarters  and 
operations,  scheduling  activities  and  a large  squadron  briefing  room  are  pro- 
vided which  can  be  subdivided  into  smaller  briefing/mission  planning  areas  by 
moveable  partitions. 

B-l  courses,  instructional  material  and  methods  are  developed  and 
evaluated  in  the  ISD  space. 

A list  of  devices  and  functional  activities  assumed  for  this 
portion  of  the  study  with  required  space  follows: 


NUMBER  SPACE  SF 


Carrels 

Familiarization  Trainer 
Instructors’  Offices 
Briefing/Critique  § Mission 
Planning 
Library  and  CMI 
ISD 

Command  and  Administration 
Hall,  stairs  and  storage 
Add  space  taken  up  by  wall  for 
total  outside  building  area 

Total  Academic-Administration 


13 

1000 

4 

480 

10  Offices 

5270 

11 

2320 

2 

500 

3 

1250 

4 

1600 

3630 

1250 

17,300  SF 
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r' 
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4. 5. 2. 2 Personnel  to  be  Accommodated 


offices  in^isti^r  the,  Personnel  »ho  will  have  permanent 

shift?  builchng  and  also  shows  occupancy  on  a typical  operating 


AREAS 


PERSONNEL  ASSIGNED 
PERMANENT  OFFICES 


PERSONNEL  ON  DUTY  DURING 
A TYPICAL  SHI FT 


Carrels 

Trainers 

Instructors  and  Flight 
Commanders 
Brief  ing/Critiq*  e 
Library 
ISD 

Command  § Administration 


4. 5. 2. 3 


Interrelationship  With  Other  Facilities 


‘ 2™; ;;  - 

Se^ichirnrfrr to  i5come  the  -£*» 

flo“epU„  5 approximately 
4. 5. 2. 4 Schedule 


first  B-l  I^thfcfT^Li5  rqUired  Six  months  Prior  t0  the  ar rival  of  the 
irst  d 1 at  the  CCTS  base  for  instructor  training  and  ISD  activities. 

Utilities 


4. 5. 2. 6 


power  users^TW^  fa"*iliarizati°n  trainers  use  standard  110V  AC  and  low 

requirements  are  for  n^mafadS^s^S^e'Sfi????'  Hea^ndT"  “V*?1* 
mg  are  required  for  comfort  and  to  meet  AFM  88-15  standards.  **  C™  ltl0,,‘ 

4. 5. 2. 7 Utilization 


facility  twomiS-^ainingJand  mission  Planning  will  be  conducted  in  this 
Make  un  S ShlftS uP!r  day>  each  6 hou^  in  duration,  5 days  a week 

sixth  da?  Since  ^ched“ling  can  be  expected  to  extend  these  hours  to'a 

‘ xth  day.  Since  flying  functions  might  extend  over  all  parts  of  the  day 


mm 


13 

**  m 

8 

*•  * 

76 

35 

• . 

28 

3 

1 

- * 

13 

12 

9 

8 

u 

TOTAL 

105 

n 

106 


and  night,  full  24-hour  availability  of  the  mission  planning  rooms  is  re- 
quired. 

4.5.3  CCTS  AIRCREW  TRAINER  BUILDING 

4. 5. 3.1  Description 

Trainers  will  be  employed  extensively  to  support  a significant 
portion  of  the  B-l  aircrew  training  program.  The  general  functions  to  be 
performed  in  this  building  are  student  training  on  devices,  maintenance 
support  of  the  equipment  and  administration  of  activities.  Detailed  descrip- 
tions of  these  functions  and  devices  is  provided  elsewhere  in  this  report. 

4 . 5 . 3 . 2 List  of  Devices  and  Space  Requirements 

The  following  space  requirements  have  been  estimated  to  accommodate 
the  devices  in  their  operational  mode.  This  space  also  allows  for  access 
and  passageways.  Because  the  devices  have  been  only  functionally  defined  in 
this  study,  it  has  been  necessary  to  estimate  their  physical  characteristics, 
i.e.,  size,  power  requirements,  etc.,  from  state-of-art  hardware  knowledge. 


Procedures  Trainers 

Space  Each 

Total 

Pilot/Copilot 

Incl.  station  6 mini  computer 

2 

300 

600 

OSO 

Incl.  station  5 computer 

3 

240 

720 

DSO 

Inci.  station  6 computer 

2 

240 

480 

1800 

Part -Mission  Trainers 

Pilot/Copilot 
Incl.  station,  pumps, 
console  $ racks 

3 

1950 

5850 

OSO 

Incl.  station,  console 
6 racks 

3 

825 

2475 

DSO 

Incl.  station,  console 
5 racks 

4 

600 

2400 

10,725 

* Subsequent  analyses  indicated  that  the  addition  of  one  Pilot/Co-Pilot  Part- 
Mission  Trainer,  one  0S0  Part-Mission  Trainer,  and  one  Full-Mission  Trainer 
interface  unit  are  required  but  have  not  been  included  in  the  facility 
drawings . 
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Full -Mission  Trainer 


} ( 
k 


I 


i 

I 


When  three  part-task  trainers  (pilot/copilot,  0S0  and  DSO) , are 
connected  electronically,  they  make  up  an  integrated  full-mission  trainer. 
Full-mission  trainer  space  is  accounted  for  in  the  totals  of  the  part- 
mission  trainers. 


Support  Areas  for  Trainers 

Briefing  7 rooms 

1190 

Maintenance  and  Storage 

4950 

Administration 

450 

Halls,  Toilets,  Stairs 

5600 

Building  Mechanical  Utilities 

Support  Total 

1740 

13,930 

Wall  space  to  be  added  for 
entire  building 

1560 

Total  SF  for  simulator 
building  when  measured 
outside  allowing  for 
all  of  above.  Does  not 
include  CCTS  Academic - 
Admin,  areas 

Total 

28,015 

Personnel  to  be  Accommodated 

The  table  below  lists  the  personnel  who  will  operate  in  this 
facility  during  a typical  shift. 


AREAS 

NO.  REQUIRED 

PERSONNEL  PER  SHIFT 

2/P/CP 

2 

6 

2/0S0 

3 

6 

2/DSO 

2 

4 

3/P/CP 

3 

9 

3/0S0 

3 

6 

3/DSO 

4 

8 

Briefing  Rooms 

7 

20 

Maintenance 

4 

30 

Administration 

2 

5 
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Personnel  to  be  Accommodated  (Continued) 


AREAS 


NO.  REQUIRED 


PERSONNEL  PER  SHIFT 


Instructors 


35 


TOTAL 


129 


4'5'3*5  Interrelationship  with  Other  Facilities 

In  Fig^e'lS  S”lf1b"ildjng  Wlth  CCTS^cadeinics -administration  comple"' 
JonHn^d  i l0°r  llm  for  the  CCTS  academic-administration  space  is 

SSSSj-SaSST  tKe  fl0Or>  ”lthln  the 

4.5. 3.6  Schedules 


This  facility  will  require  at  least  one  year  for  construction  after 
the  contract  is  let.  It  will  be  needed  nine  months  prior  to  arrival  of  the 
first  B-l  at  the  CCTS  base.  After  completion,  equipment  installation  and 
checkout  will  take  three  months.  It  will  be  operated  to  train  instructors  for 
six  month'-  before  actual  flying  begins. 

4 • 5 . 3 . 7 Type  of  Construction 

Normal  industrial  type  construction  such  as  metal  or  concrete  to 
meet  A-M  88-15  standards  is  appropriate  for  the  trainer  facility. 

facility  must  be  capable  of  handling  classified  material 
(mission  tapes,  etc.).  The  simulator  equipment  should  be  designed  for  maxi- 
mum suppression  or  elimination  of  EMI  and  RFI . However,  experience  with  other 
simulators  leads  to  a requirement  for  building  screen  shielding  to  protect 
the  electronic  racks  from  outside  interference,  and  also  to  prevent  possible 
classified  data  emissions. 


The  design  should  include  elevated  floors  in  the  computer  and 
trainer  rooms.  This  allows  for  conditioned  air  ducting  and  wiring  below  the 
equipment  racks.  The  false  floor  is  readily  removable  for  checks  on  wiring 
or  rerouting  to  accommodate  equipment  changes.  Consideration  should  also  be 
given  to  the  location  of  dedicated  air  conditioning  packages  above  the  com- 
puter rooms.  This  concept  has  been  found  to  be  more  cost-effective  in  cooling 
electronic  racks  than  a large  central  sir  system  for  the  entire  building.  A 
central  system  is  satisfactory  for  normal  comfort  cooling  and  heating  of  ad- 
ministrative and  maintenance  areas. 

The  pilot/copilot  motion  platforms  for  the  part-mission  trainer 
require  a high  bay  area  on  the  order  of  24  feet  clearance.  Entrance  to  these 
devices  should  be  by  enclosed  ramp  at  the  level  of  the  cockpits.  Consoles 
for  the  part-mission  trainers  should  be  housed  in  relatively  sound-proof  rooms 
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FIRST  FLOOR  OF  CCTS  SIMULATER  TRAINER  BUILDING' 


ure  13  CCTS  ACADEMIC-ADMINISTRATION  SPACE  18,400  SQ.  FT. 

(OPTIONS:  SECOND  FLOOR  ABOVE  SIMULATOR  SPACE,  OR  SEPARATE  FACILITY) 


COMPUTER  RACKS 
3/P/C  P/OSO/DSO 
4/INTERFACE 


BUI LOING  MECHANICAL 


COMPUTER  RACKS 
3/P/CP/OSO/DSO 
4/INTEP.FACE 


3/P /CP 
PUMP  ROOM 


3/P/CP 


INSTRUCTOR 
CONSOLES 
3/P/CP/OSC/OSO 
4 INTERFACE 


3/P/CP 


BRIEFING 

~~r 

BRIE*FING 

• 

1 

MAINTENANCE 

3/OSO 

MAINTENANCE  | 

SHOP 

3/OSO 

MAINTENANCE 

SUPERVISION 

3/OSO 

ANO 

ADMINISTRATION 

CONFERENCE 

RADAR 

1 

BRIEFING 

PREDICTION 

UPOATE 

1 

OEPOT  LEVEL 
MAINTENANCE 
ANO 

TECH  REPS 


SUPPLY 


STORAOC 


1 0*0 


2/P/CP 


2 OSO 


3/P/CP 
PUMP  ROOM 


OIRFCTOR 

OF 

OEVICES 


AOMIN. 


STAIRS 


10  20  30 

■ I I,,  » 

SCALE  IN  FEET 

Figure  15  MOB  SIMULATOR-TRAINER  BUILDING 
APPROXIMATE  AREA  21,000  SQ.  FT. 
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with  glass  walls  that  permit  visual  monitoring  of  the  motion  platforms  with 
cockpits , 


4.5. 3. 8 Utilities 

Estimated  Power  Requirements  For  Devices  Totals 


Part-Mission  Trainer  - Flight  Station 
Pumps,  platform,  cockpit  and 

computers  100  KW  per  (3  stations)  300  KVA 

Part-Mission  Trainer  - 0S0 
Station,  landmass  and 

computers  90  KW  (3  stations)  270  KVA 

Part -Mission  Trainer  - DSO 
Station,  and  computers 

30  KW  (4  stations)  120  KVA 

Procedures  Trainer 

Stations  and  mini  computers 

20  KW  (7  stations)  I40 

Heating  and  comfort  air  conditioning  for  support  areas  is  to 
conform  with  AFM  88-15. 

4. 5. 3. 9 Utilization 

The  devices  will  be  scheduled  5 days  for  80  hours  a veek  minimum. 
Operating  time  for  an  additional  16  hour  day  will  be  required  for  make-up 
and  other  rescheduling.  Maintenance  will  be  performed  6 davs  a week. 
Maintenance  crews  will  be  on  duty  3 shifts  per  day.  Unscheduled  work  will 
be  performed  on  devices  during  training  shifts  to  correct  random  malfunctions. 
The  third  shift  will  be  used  for  periodic  maintenance. 


4.5.4  MOB  AIRCREW  SIMULATOR  AND  TRAINER  BUILDING 

At  a typical  MOB,  there  will  be  one  set  of  part-mission  trainers, 
and  one  full-mission  trainer  device,  each  composed  of  a set  of  part -mission 
trainers,  i.e.  a gilot/copilot  (P/CP),  offensive  systems  officer  (0S0) , and 
a defensive  systems  officer  (DSO)  station.  There  will  also  be  three  pro- 
cedures trainers,  one  for  each  crew  position. 


113 


The  trainers,  as  shown  in  the  facility  layout  in  Figure  15,  are  as 
follows.  The  familiarization  trainers  for  pilot/copilot  are  referred  to  as 
2/P/CP,  for  0S0  as  2/0S0,  etc.  The  part-mission  training  is  3/P/CP,  etc. 
The  Full-Mission  Trainer  is  formed  by  connecting  the  part-task  trainer 
electronically.  The  only  references  in  the  drawing  to  the  full-mission 
trainer  is  in  the  rack  and  console  rooms  where  the  computers  are  interfaced 
i.e.,  4/Interface. 


Learning  carrels  and  familiarization  trainers  may  be  housed  in 
any  operational  area  such  as  alert.  Squadron  Ops.,  etc.  No  space  has  been 
assigned  to  these  devices  in  the  simulator  building. 


SPACE  REQUIREMENTS 


Devices 

Number 

Space  Each 

Total 

Procedures  Trainer-P/CP 

1 

300 

300 

Procedures  Trainer-OSO 

1 

240 

240 

Procedures  Trainer-DSO 

1 

240 

240 

Part -Mission  Trainer-P/CP 
Incl.  station,  pumps, 
console  and  racks 

2 

1950 

3900 

Part -Miss ion  Trainer-OSO 
Incl.  station,  console 
and  racks 

2 

825 

1650 

Part-Mission  Trainer-DSO 
Incl.  station,  console 
and  racks 

2 

600 

1200 

Subtotal  7530 


4. 5. 4.1  Full-Mission  Trainer 


When  three  part-task  stations  (pilot/copilot,  0S0  and  DSO) , Part- 
Mission  Trainers  are  connected  electronically,  they  make  up  an  integrated 
crew  mission  simulator,  Full-Mission  Trainer.  Full-Mission  Trainer  space  is 
accounted  for  in  the  total  of  the  Part -Mission  Trainer  above. 


Support  Areas 


Briefing  Rooms  f5) 

• 780 

Maintenance  and  Storage 

5100 

Administration 

800 

Predication  Update 

220 

Building  Mechanical 

1340 

Halls,  Stairs,  Toilets 

5^60 

and  Walls 


Subtotal  for  Support  13,500 


Total  Square  Footage  21,030 


The  table  below  lists  the  personnel  who  will  operate  in  this 
facility  during  a typical  shift. 


Areas 


No.  Required  Personnel  per  Shift 


2/P/CP  1 
2/OSQ  1 
2/DSO  1 
.3/P/CP  2 
3/0S0  2 
3/DSO  2 
Briefing  Rooms  5 
Maintenance  $ Supply  6 
Administration  3 
Instructors 

Update  1 


2 

1 

1 

4 

2 

2 

14 

27 

4 

4 

1 


Total  52 


The  simulator-trainer  building  should  be  adjacent  to  the  alert 
facility  if  practical,  if  not,  as  close  to  the  alert  and  other  operational 
areas  as  possible. 
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These  simulator  facilities  should  be  operational  at  MOBs  to  phase 
in  as  the  aircraft  arrive. 

Construction  is  to  be  in  accordance  with  AFM  88-15  standards. 

Other  design  considerations  follow  that  of  the  CCTS  aircrew  trainer  building 
in  particular  with  respect  to: 

o  EMI-RFI  screening 

o Pump  room  isolation 

o Corputer  room  floor 

o Air  conditioning  packages  for 
equipment  cooling 

o High  bay  area? 

o Entrance  to  pilot/copilot  cockpit 
o Heating  and  air  conditioning 
o Console  rooms 

See  the  following  table  for  power  requirements. 

Device  Power  for  Devices 

1 Part -Mission  Trainers 

pumps  platform,  cockpit  commuters  and  console, 

IDO  KVA  (2  each) 

2 Part -Mission  Trainers 

station,  landmass,  computers  and  console, 

90  KVA  (2  each) 

3 Part-Mission  Trainers 

station,  computers  and  console,  30  KVA 
(2  each) 

4 Procedures  Trainer 

stations  and  mini  computers,  30  KVA 
3 each) 


Totals 
200  KVA 

180  KVA 

60  KVA 

60  KVA 


This  facility  must  be  capable  of  handling  Top  Secret  SIOP/ESI 
tapes  and  other  material. 
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4. 5. 4. 2 Utilization 


H > 

r * I 

I 

I 


The  facilities  will  be  scheduled  7 days  a week  and  will  operate 
96  hours  a week  minimum.  Operating  time  above  96  hours  will  be  required  for 
make-up  and  other  necessary  rescheduling.  Maintenance  will  be  performed  7 
days  a week.  Maintenance  crews  will  be  on  duty  3 shifts  per  day.  Mainte- 
nance scheduling  will  be  at  the  convenience  of  the  unit  traini*  - coordinator. 


Section  5 


CONCLUDING  REMARKS 


The  SAT  process  has  been  followed  to  provide  the  B-l  SPO  with  the 
recommendations  of  the  previous  sections  of  this  report.  The  preferred  in- 
structional system,  however,  is  not  complete  as  described  in  a number  of 
important  ways,  nor  has  the  SAT  process  been  carried  out  in  its  entirety. 

The  "next  steps"  that  must  be  taken  are  discussed  in  this  concluding  section 
in  approximately  the  same  order  as  that  in  which  they  should  be  performed. 

1.  Development  of  the  DSO  Syllabus.  A complete  task  analysis  for 
the  Defensive  Systems  Operator  (DSO)  was  not  available  in  sufficient  time  to 
be  analyzed  as  part  of  this  program.  Some  assumptions  were  made  regarding 
the  likely  training  resource  requirements  for  the  DSO  so  that  a better  approx- 
imation of  the  entire  aircrew  training  system  could  be  provided  in  this  report. 
The  first  "next  step"  should  obviously  be  to  complete  the  definition  of  the 
DSO  syllabus,  its  training  device  requirements,  and  its  other  resource  re- 
quirements. 

2.  Determination  of  the  B-l  Performance  Characteristics.  As 
additional  experience  is  gained  from  the  B-l  prototype  test  flights  and  as 
the  design  specifications  of  B-l  systems  are  finalized,  information  regarding 
the  performance  characteristics  of  the  B-l  should  be  made  available  to  the 
training  analysts  who  will  assume  responsibility  after  this  study.  Examples 
of  the  nature  of  such  data  include: 

1)  acceleration  characteristics  during  normal  and 
emergency  maneuvers; 

2)  operational  flight  program  characteristics 
for  the  on-board  computers; 

3)  updates  in  equipment  specifications;  and  so  forth. 

The  analysts  would  use  that  information  to  refine  the  functional 
specifications  of  the  training  devices  and/or  to  refine  the  data  in  the  task 
analysis  and  the  behavioral  objectives,  thus  filling  in  a number  of  entries 
which  are  now  TBD  (to  be  determined). 

3.  Completion  of  the  Task  Analysis.  The  task  analysis  delivered 
to  Calspan  for  use  in  this  program  contained  only  information  for  a "perfect" 
EWO  mission.  It  did  not  cover  tasks  related  to  CONUS  airspace  regulations, 
nor,  more  importantly,  did  it  contain  malfunction  and  emergency  task  des- 
criptions. These  latter  tasks  were  generated  from  other  documents  available 
to  the  Calspan  analysts  and  incorporated  as  a Mission  Segment  20.  In  con- 
junction with  Item  2 above,  new  information  will  become  available  to  further 
delineate,  refine,  and  Complete  the  task  analysis  data  base.  Further  re- 
finements of  the  B-l  Aircrew  Instructional  System  may  then  be  implemented. 
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4.  Criterion  Test  Development.  Because  of  the  deficiencies  noted 
in  Items  2 and  3,  it  was  not  possible  to  complete  a specification  of  the 
criterion  tests  to  be  used  to  measure  attainment  of  the  training  (behavioral) 
objectives.  It  has  been  recognized,  however,  that  testing  will  be  an  integral, 
and  usually  "on-line,"  part  of  the  training  program.  This  is  in  keeping  with 
the  instructional  strategies  employed  (e.g.,  individualized  instruction,  use 
of  computer -managed  instruction,  early  hands-on,  student-paced,  and  so  forth). 
As  the  TBDs  are  eliminated  from  the  performance  requirements  specifications  in 
the  behavioral  objectives,  the  criterion  performance  will  then  be  available 
for  inclusion  in  the  criterion  test  specifications. 

5.  Refinement  of  Input  Data.  The  assumptions  used  in  this  program 
are  generally  those  that  are  documented  in  Appendix  A to  this  report  (Tech- 
nical Memorandum  SAT-1,  Vol.  2).  The  quality  of  this  data  is  also  indicated 
along  a three-point  scale  covering  the  range  from  "good"  to  "poor"  reliability. 
The  data  used  were  the  best  available  as  determined  by  the  analysts,  but  be- 
cause data  of  "low"  and  "fair"  reliability  are  included,  it  is  recommended 
that  such  data  are  further  investigated  via  whatever  means  possible  to  achieve 
an  increase  in  overall  reliability  of  the  estimates  generated  by  the  Training 
Resources  Analytic  Model  (TRAM) . An  example  of  such  data  are  the  costs  asso- 
ciated with  the  component  parts  of  the  various  training  devices,  especially 
Devices  3 and  4. 

6.  Further  System  Analyses.  Many  factors  affect  the  characteris-. 
tics  of  the  training  system.  Those  factors  are  the  ones  included  as  input 
variables  to  TRAM.  The  previous  section  of  this  report  and  Appendix  A 
(Technical  Memorandum  SAT-1,  Vol.  2)  describes  some  of  the  ramifications  of 
alternative  structuring  of  the  preferred  instructional  system.  As  the  total 
B-l  development  program  proceeds,  many  of  these  factors  will  become  fixed 
via  constraints  and/or  doctrine,  while  other  factors  may  take  on  a new  im- 
portance (e.g.,  the  current  fuel  crisis).  As  an  on-going  effort,  the  rami- 
fications of  current  decisions  should  be  re-examined  (using  TRAM)  in  light 
of  new  alternatives  that  become  probable  or  possible  for  consideration. 

These  include  new  basing  concepts,  partial  centralization  of  Proficiency 
Maintenance  Training  concepts  other  than  those  considered  in  this  report, 
new  training  device  technology,  and  unpredicted  changes  in  costs  or  budgets. 

7.  Training  Device  Specifications.  Although  it  is  realized  that 
procurement  of  facilities  and  training  devices  must  be  initiated  soon,  all 

of  the  above  items  will  impact  on  the  final  specifications  of  the  recommended 
training  devices.  Integration  of  that  information  (the  above  items)  should 
be  made  the  responsibility  of  those  who  formulate  those  specifications.  This 
implies  a good  working  relationship  between  the  several  individuals  who  will 
be  involved  in  that  process,  including  those  who  eventually  will  be  respon- 
sible for  administering  the  crew  member  proficiency  measures  and  providing 
the  necessary  feedback  to  the  training  course  development  team. 
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Certain  items  were  left  open-ended  in  the  functional  descriptions 
of  the  training  devices  (e.g.,  the  use  of  the  on-board  computer  hardware  in 
the  training  devices) . Closure  can  only  be  obtained  on  such  items  as  new 
information  is  gathered  from  within  and  without  the  B-l  Program.  Guidance 
should  be  taken  from  the  experience  of  other  programs,  military  and  civilian, 
(in  their  proper  context)  along  with  the  discussions  in  the  Simulation  Tech- 
nology Assessment  Report  (Technical  Memorandum  SAT-3). 

8.  Training  System  Implementation.  The  finalization  of  the  in- 
structional system  design  allows  the  final  four-step  process  to  be  initiated. 
Those  steps  are: 

a)  development  of  lesson  specifications; 

b)  production  of  courseware,  software, 
and  hardware; 

c)  deployment  of  the  instructional  system; 
and , 

d)  quality  control. 

Lesson  specifications  for  each  course  will  be  derived  on  the  basis 
of  the  instructional  block  sequence  (Section  3)  and  the  behavioral  objectives 
(Technical  Memorandum  SAT-2) , plus  any  updates  to  either  that  result  from  the 
refinements  due  to  Items  1 to  7 above.  The  production  of  the  courseware 
(texts,  slides,  tapes,  etc.)  and  training  devices  software  and  hardware  is 
the  obvious  next  step,  which  then  allows  the  deployment  of  the  instructional 
system  in  the  field  (preferably  following  preliminary  try-outs  on  small 
samples  of  students).  Once  the  system  becomes  operational,  it  is  vitally 
important  to  establish  a quality  control  program  that  allows  the  SAC  Head- 
quarters ISD  team  to  detect  flaws  in  any  of  the  components  making  up  the 
entire  instructional  system.  Feedback  of  students'  performance  from  all 
points  in  their  progress  (CCTS  and  MOBs)  via  the  computer-managed-instruction 
system  allows  for  the  ongoing  validation  of  all  aspects  from  the  task  analysis 
to  the  courseware  and  criterion  tests.  Many  of  the  applicable  techniques  are 
well-known  ("item  analysis"  from  the  tests  and  measurements  field),  while 
others  will  depend  upon  the  experience  and  good  judgment  of  the  ISD  team  (e. 
g. , selection  of  performance  measures  to  be  monitored  in  the  devices  or  air 
vehicle).  The  inclusion  of  a quality  control  system  and  the  application  of 
TRAM  will  make  possible  the  assessment  of  new  or  proposed  changes  to  the  in- 
structional system.  Of  particular  importance  are  changes  relating  to  instruc- 
tional block  durations,  Proficiency  Maintenance  training  requirements,  and 
the  myriad  changes  brought  about  by  altering  the  basing  structure,  crew  ratio, 
and  so  forth. 
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The  Systems  Approach  to  Training  is  certainly  no  panacea  for 
instructional  system  development.  It  offers  the  systems  analytic  techniques, 
but  cannot  compensate  for  technically  poor  decisions,  cannot  induce  creativity 
and  innovation  into  the  decision  processes,  and  cannot  provide  more  than  a 
pointer  to  the  research  that  is  yet  necessary  to  provide  the  stuff  from  which 
good  decisions  can  come.  Calspan  has  applied  the  talents  of  a highly  diver- 
sified team  to  provide  a comprehensive  analysis  of  the  B-l  aircrew  training 
requirements  that  may  be  looked  upon  as  a prototype  for  future  programs.  It 
is  believed  by  the  authors  that  the  documentation  provided  by  the  reports 
listed  in  the  Preface  approaches  the  state-of-the-art  in  the  Systems  Approach 
to  Training. 


t 


This  technical  memorandum  completes  all  effort  on  the  Systems 
Approach  to  Training  program. 
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Section  6 


Allocation  of  Instructional  Blocks  to  Behavioral  Objectives 

According  to  Track 


Table  18,  presented  on  the  following  pages,  indicates  the 
instructional  blocks  within  which  the  criteria  of  each  Behavioral  Objective 
(Beh.Obj . ) are  first  attained.  The  listing  is  according  to  tracks  (see 
Section  3.4.3)  for  the  Pilot,  Copilot,  and  0S0,  plus  the  Synchronization  track 
in  which  all  crew  positions  participate.  Behavioral  Objectives  for  the  DSO 


were  not  prepared  as  part  of  this  program. 
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Allocation  of  Instructional  Blocks  to  Behavioral  Objectives  According  to  Track 
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